{"id":2039,"date":"2023-11-27T15:28:47","date_gmt":"2023-11-27T15:28:47","guid":{"rendered":"https:\/\/denayer.com\/blog\/?p=2039"},"modified":"2024-02-03T10:21:37","modified_gmt":"2024-02-03T10:21:37","slug":"not_my_first_hype_cycle","status":"publish","type":"post","link":"http:\/\/denayer.com\/blog\/not_my_first_hype_cycle\/","title":{"rendered":"This is not my first hype cycle"},"content":{"rendered":"\n[et_pb_section fb_built=”1″ _builder_version=”4.23.1″ _module_preset=”default” global_colors_info=”{}”][et_pb_row _builder_version=”4.23.1″ _module_preset=”default” custom_margin=”-1px|auto||auto||” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.23.1″ _module_preset=”default” global_colors_info=”{}”][et_pb_text _builder_version=”4.23.1″ _module_preset=”default” custom_padding=”0px|||||” hover_enabled=”0″ global_colors_info=”{}” sticky_enabled=”0″]

Every time a new technology comes along, we seem to first believe that it will (a) replace all previous technologies and (b) that it will solve all future problems. Inevitably we then discover the limitations and then finally we put the new tool where it belongs, in its own niche where it shines.<\/span> <\/span>
<\/span>
<\/span>As expected, the same is now happening to large language models. The hype machine would have us believe that increasing the model size would lead to \u201cemergent properties\u201d that would bring us general artificial intelligence (AGI)<\/span>\u00a0in no time. The misconception arose that 10x in model parameters would directly translate to 10x in machine intelligence and that this would come with GPT-5 or surely at the latest with GPT-6. Luckily, we have experts like<\/span> <\/span><\/span><\/a>Gary Marcus<\/a> <\/span>and<\/span> <\/span><\/span><\/a>Yann LeCun<\/a> <\/span>remind us of LLM<\/span>\u00a0<\/span>limitations.<\/span>
<\/span>
<\/span>Sam Altman of OpenAI<\/span><\/span> <\/span>has been a prominent voice in pumping the hype, leading to anxiety in society and with policy makers. So why did he just now acknowledge that\u00a0LLMs\u00a0will\u00a0not\u00a0get us to AGI and that a new path of research is needed?\u00a0\u00a0Is it possible that<\/span> GPT5 <\/span>development is not working out as hoped? Maybe he\u2019s getting ahead of the \u201ctrough of disillusionment\u2019? Should we see this statement in light of his quest to raise more money?<\/span> <\/span>
<\/span>
<\/span>In any case he\u2019s owning the<\/span> AI <\/span>narrative for the moment which must be pretty frustrating to other big players.<\/span>
<\/span>
<\/span>The positive news might be that attention and investment can shift a bit away from LLMs and new avenues can be explored again.\u00a0\u00a0As the field continues to evolve, I’m curious about others’ views on the future of AI. What do you think will be the next significant breakthrough?<\/span> <\/span><\/p>[\/et_pb_text][et_pb_image src=”http:\/\/denayer.com\/blog\/wp-content\/uploads\/2023\/12\/not_my_first_hype_cycle.jpg” title_text=”not_my_first_hype_cycle” _builder_version=”4.23.1″ _module_preset=”default” hover_enabled=”0″ global_colors_info=”{}” sticky_enabled=”0″][\/et_pb_image][\/et_pb_column][\/et_pb_row][\/et_pb_section]\n","protected":false},"excerpt":{"rendered":"

Every time a new technology comes along, we seem to first believe that it will (a) replace all previous technologies and (b) that it will solve all future problems. Inevitably we then discover the limitations and then finally we put the new tool where it belongs, in its own niche where it shines.<\/p>\n","protected":false},"author":1,"featured_media":2043,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"on","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[34],"tags":[],"class_list":["post-2039","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai"],"aioseo_notices":[],"_links":{"self":[{"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts\/2039","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/comments?post=2039"}],"version-history":[{"count":0,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/posts\/2039\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/media\/2043"}],"wp:attachment":[{"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/media?parent=2039"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/categories?post=2039"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/denayer.com\/blog\/wp-json\/wp\/v2\/tags?post=2039"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}