{"id":2050,"date":"2023-11-25T15:40:26","date_gmt":"2023-11-25T15:40:26","guid":{"rendered":"https:\/\/denayer.com\/blog\/?p=2050"},"modified":"2024-02-03T10:21:37","modified_gmt":"2024-02-03T10:21:37","slug":"ai_debt","status":"publish","type":"post","link":"https:\/\/denayer.com\/blog\/ai_debt\/","title":{"rendered":"Massive AI technical debt incoming&#8230;"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.23.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.23.1&#8243; _module_preset=&#8221;default&#8221; custom_margin=&#8221;-1px|auto||auto||&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.23.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text _builder_version=&#8221;4.23.1&#8243; _module_preset=&#8221;default&#8221; custom_padding=&#8221;0px|||||&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<p><span>we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data.<\/span><span class=\"white-space-pre\"> <\/span><span><br \/><\/span><span><br \/><\/span><span>With LLMs the models themselves also \u2018drift\u2019 in that<\/span><span class=\"white-space-pre\"> <\/span><span><br \/><\/span><span><br \/><\/span><span>&#x1f504; they are unpredictable (cf the temperature setting) and<\/span><span><br \/><\/span><span>&#x1f195; when a new version of the model is released, as will inevitably happen with<\/span><span class=\"white-space-pre\"> ChatGPT<\/span><span><\/span><span>,<\/span><span class=\"white-space-pre\"> <\/span><span><span class=\"visually-hidden\"><a class=\"app-aware-link \" href=\"https:\/\/www.linkedin.com\/feed\/hashtag\/?keywords=claude&amp;highlightedUpdateUrns=urn%3Ali%3Aactivity%3A7127278496749375488\" data-test-app-aware-link=\"\"><\/a>\u00a0Claude <\/span><\/span><span>and all the others, we do not know how the model will react.<\/span><span><br \/><\/span><span><br \/><\/span><span>so be ready to closely monitor and then revise all of your carefully crafted prompts. Did you put that part in the business case?<\/span><\/p>\n<p>[\/et_pb_text][et_pb_image src=&#8221;http:\/\/denayer.com\/blog\/wp-content\/uploads\/2023\/12\/1699182573065.jpeg&#8221; title_text=&#8221;1699182573065&#8243; _builder_version=&#8221;4.23.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p> we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. <\/p>\n<p>With LLMs the models themselves also \u2018drift\u2019 in that<\/p>\n","protected":false},"author":1,"featured_media":2052,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[34],"tags":[],"class_list":["post-2050","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"aioseo_notices":[],"aioseo_head":"\n\t\t<!-- All in One SEO 4.9.9 - aioseo.com -->\n\t<meta name=\"description\" content=\"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that\" \/>\n\t<meta name=\"robots\" content=\"max-image-preview:large\" \/>\n\t<meta name=\"author\" content=\"Wouter Denayer\"\/>\n\t<link rel=\"canonical\" href=\"https:\/\/denayer.com\/blog\/ai_debt\/\" \/>\n\t<meta name=\"generator\" content=\"All in One SEO (AIOSEO) 4.9.9\" \/>\n\t\t<meta property=\"og:locale\" content=\"en_US\" \/>\n\t\t<meta property=\"og:site_name\" content=\"Wouter&#039;s blog\" \/>\n\t\t<meta property=\"og:type\" content=\"article\" \/>\n\t\t<meta property=\"og:title\" content=\"Massive AI technical debt incoming\u2026 | Wouter Denayer_\" \/>\n\t\t<meta property=\"og:description\" content=\"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that\" \/>\n\t\t<meta property=\"og:url\" content=\"https:\/\/denayer.com\/blog\/ai_debt\/\" \/>\n\t\t<meta property=\"article:published_time\" content=\"2023-11-25T15:40:26+00:00\" \/>\n\t\t<meta property=\"article:modified_time\" content=\"2024-02-03T10:21:37+00:00\" \/>\n\t\t<meta name=\"twitter:card\" content=\"summary\" \/>\n\t\t<meta name=\"twitter:title\" content=\"Massive AI technical debt incoming\u2026 | Wouter Denayer_\" \/>\n\t\t<meta name=\"twitter:description\" content=\"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that\" \/>\n\t\t<script type=\"application\/ld+json\" class=\"aioseo-schema\">\n\t\t\t{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#article\",\"name\":\"Massive AI technical debt incoming\\u2026 | Wouter Denayer_\",\"headline\":\"Massive AI technical debt incoming&#8230;\",\"author\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/author\\\/wouterd\\\/#author\"},\"publisher\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/#organization\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/1699182573065.jpeg\",\"width\":1792,\"height\":1024},\"datePublished\":\"2023-11-25T15:40:26+00:00\",\"dateModified\":\"2024-02-03T10:21:37+00:00\",\"inLanguage\":\"en-US\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#webpage\"},\"isPartOf\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#webpage\"},\"articleSection\":\"artificial intelligence\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#breadcrumblist\",\"itemListElement\":[{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog#listItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/denayer.com\\\/blog\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/category\\\/ai\\\/#listItem\",\"name\":\"artificial intelligence\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/category\\\/ai\\\/#listItem\",\"position\":2,\"name\":\"artificial intelligence\",\"item\":\"https:\\\/\\\/denayer.com\\\/blog\\\/category\\\/ai\\\/\",\"nextItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#listItem\",\"name\":\"Massive AI technical debt incoming&#8230;\"},\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog#listItem\",\"name\":\"Home\"}},{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#listItem\",\"position\":3,\"name\":\"Massive AI technical debt incoming&#8230;\",\"previousItem\":{\"@type\":\"ListItem\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/category\\\/ai\\\/#listItem\",\"name\":\"artificial intelligence\"}}]},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/#organization\",\"name\":\"Wouter Denayer_\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/author\\\/wouterd\\\/#author\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/author\\\/wouterd\\\/\",\"name\":\"Wouter Denayer\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#authorImage\",\"url\":\"http:\\\/\\\/denayer.com\\\/blog\\\/wp-content\\\/uploads\\\/2014\\\/06\\\/Wouter-Denayer_avatar_1402952138-96x96.jpg\",\"width\":96,\"height\":96,\"caption\":\"Wouter Denayer\"}},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#webpage\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/\",\"name\":\"Massive AI technical debt incoming\\u2026 | Wouter Denayer_\",\"description\":\"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \\u2018drift\\u2019 in that\",\"inLanguage\":\"en-US\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/#website\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#breadcrumblist\"},\"author\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/author\\\/wouterd\\\/#author\"},\"creator\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/author\\\/wouterd\\\/#author\"},\"image\":{\"@type\":\"ImageObject\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/1699182573065.jpeg\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#mainImage\",\"width\":1792,\"height\":1024},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/ai_debt\\\/#mainImage\"},\"datePublished\":\"2023-11-25T15:40:26+00:00\",\"dateModified\":\"2024-02-03T10:21:37+00:00\"},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/denayer.com\\\/blog\\\/\",\"name\":\"Wouter's blog\",\"inLanguage\":\"en-US\",\"publisher\":{\"@id\":\"https:\\\/\\\/denayer.com\\\/blog\\\/#organization\"}}]}\n\t\t<\/script>\n\t\t<!-- All in One SEO -->\n\n","aioseo_head_json":{"title":"Massive AI technical debt incoming\u2026 | Wouter Denayer_","description":"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that","canonical_url":"https:\/\/denayer.com\/blog\/ai_debt\/","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#article","name":"Massive AI technical debt incoming\u2026 | Wouter Denayer_","headline":"Massive AI technical debt incoming&#8230;","author":{"@id":"https:\/\/denayer.com\/blog\/author\/wouterd\/#author"},"publisher":{"@id":"https:\/\/denayer.com\/blog\/#organization"},"image":{"@type":"ImageObject","url":"https:\/\/denayer.com\/blog\/wp-content\/uploads\/2023\/12\/1699182573065.jpeg","width":1792,"height":1024},"datePublished":"2023-11-25T15:40:26+00:00","dateModified":"2024-02-03T10:21:37+00:00","inLanguage":"en-US","mainEntityOfPage":{"@id":"https:\/\/denayer.com\/blog\/ai_debt\/#webpage"},"isPartOf":{"@id":"https:\/\/denayer.com\/blog\/ai_debt\/#webpage"},"articleSection":"artificial intelligence"},{"@type":"BreadcrumbList","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#breadcrumblist","itemListElement":[{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog#listItem","position":1,"name":"Home","item":"https:\/\/denayer.com\/blog","nextItem":{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog\/category\/ai\/#listItem","name":"artificial intelligence"}},{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog\/category\/ai\/#listItem","position":2,"name":"artificial intelligence","item":"https:\/\/denayer.com\/blog\/category\/ai\/","nextItem":{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#listItem","name":"Massive AI technical debt incoming&#8230;"},"previousItem":{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog#listItem","name":"Home"}},{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#listItem","position":3,"name":"Massive AI technical debt incoming&#8230;","previousItem":{"@type":"ListItem","@id":"https:\/\/denayer.com\/blog\/category\/ai\/#listItem","name":"artificial intelligence"}}]},{"@type":"Organization","@id":"https:\/\/denayer.com\/blog\/#organization","name":"Wouter Denayer_","url":"https:\/\/denayer.com\/blog\/"},{"@type":"Person","@id":"https:\/\/denayer.com\/blog\/author\/wouterd\/#author","url":"https:\/\/denayer.com\/blog\/author\/wouterd\/","name":"Wouter Denayer","image":{"@type":"ImageObject","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#authorImage","url":"http:\/\/denayer.com\/blog\/wp-content\/uploads\/2014\/06\/Wouter-Denayer_avatar_1402952138-96x96.jpg","width":96,"height":96,"caption":"Wouter Denayer"}},{"@type":"WebPage","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#webpage","url":"https:\/\/denayer.com\/blog\/ai_debt\/","name":"Massive AI technical debt incoming\u2026 | Wouter Denayer_","description":"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that","inLanguage":"en-US","isPartOf":{"@id":"https:\/\/denayer.com\/blog\/#website"},"breadcrumb":{"@id":"https:\/\/denayer.com\/blog\/ai_debt\/#breadcrumblist"},"author":{"@id":"https:\/\/denayer.com\/blog\/author\/wouterd\/#author"},"creator":{"@id":"https:\/\/denayer.com\/blog\/author\/wouterd\/#author"},"image":{"@type":"ImageObject","url":"https:\/\/denayer.com\/blog\/wp-content\/uploads\/2023\/12\/1699182573065.jpeg","@id":"https:\/\/denayer.com\/blog\/ai_debt\/#mainImage","width":1792,"height":1024},"primaryImageOfPage":{"@id":"https:\/\/denayer.com\/blog\/ai_debt\/#mainImage"},"datePublished":"2023-11-25T15:40:26+00:00","dateModified":"2024-02-03T10:21:37+00:00"},{"@type":"WebSite","@id":"https:\/\/denayer.com\/blog\/#website","url":"https:\/\/denayer.com\/blog\/","name":"Wouter's blog","inLanguage":"en-US","publisher":{"@id":"https:\/\/denayer.com\/blog\/#organization"}}]},"og:locale":"en_US","og:site_name":"Wouter's blog","og:type":"article","og:title":"Massive AI technical debt incoming\u2026 | Wouter Denayer_","og:description":"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that","og:url":"https:\/\/denayer.com\/blog\/ai_debt\/","article:published_time":"2023-11-25T15:40:26+00:00","article:modified_time":"2024-02-03T10:21:37+00:00","twitter:card":"summary","twitter:title":"Massive AI technical debt incoming\u2026 | Wouter Denayer_","twitter:description":"we are well aware of model drift, where the input variables (the real world), over time, become different from the data distribution the model was trained on. It\u2019s not so much the model that drifts here but rather the input data. With LLMs the models themselves also \u2018drift\u2019 in that"},"aioseo_meta_data":{"post_id":"2050","title":null,"description":null,"keywords":[],"keyphrases":{"focus":{"keyphrase":"","score":0,"analysis":{"keyphraseInTitle":{"score":0,"maxScore":9,"error":1}}},"additional":[]},"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":"","og_custom_url":null,"og_article_section":null,"og_article_tags":[],"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"Article","isEnabled":true},"graphs":[]},"schema_type":"default","schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":"-1","robots_max_videopreview":"-1","robots_max_imagepreview":"large","priority":null,"frequency":"default","local_seo":null,"breadcrumb_settings":null,"limit_modified_date":false,"ai":null,"created":"2023-12-27 15:40:26","updated":"2024-01-15 16:24:10","seo_analyzer_scan_date":null},"aioseo_breadcrumb":"<div class=\"aioseo-breadcrumbs\"><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/denayer.com\/blog\" title=\"Home\">Home<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\t<a href=\"https:\/\/denayer.com\/blog\/category\/ai\/\" title=\"artificial intelligence\">artificial intelligence<\/a>\n\t\t<\/span><span class=\"aioseo-breadcrumb-separator\">&raquo;<\/span><span class=\"aioseo-breadcrumb\">\n\t\t\tMassive AI technical debt incoming\u2026\n\t\t<\/span><\/div>","aioseo_breadcrumb_json":[{"label":"Home","link":"https:\/\/denayer.com\/blog"},{"label":"artificial intelligence","link":"https:\/\/denayer.com\/blog\/category\/ai\/"},{"label":"Massive AI technical debt incoming&#8230;","link":"https:\/\/denayer.com\/blog\/ai_debt\/"}],"_links":{"self":[{"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts\/2050","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/comments?post=2050"}],"version-history":[{"count":0,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts\/2050\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/media\/2052"}],"wp:attachment":[{"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/media?parent=2050"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/categories?post=2050"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/tags?post=2050"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}