{"id":156921,"date":"2023-02-03T03:43:19","date_gmt":"2023-02-03T09:43:19","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/02\/stochastic-parrot-or-world-model-how-large-language-models-learn"},"modified":"2023-02-03T03:43:19","modified_gmt":"2023-02-03T09:43:19","slug":"stochastic-parrot-or-world-model-how-large-language-models-learn","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/02\/stochastic-parrot-or-world-model-how-large-language-models-learn","title":{"rendered":"Stochastic parrot or world model? How large language models learn"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/stochastic-parrot-or-world-model-how-large-language-models-learn2.jpg\"><\/a><\/p>\n<p><strong>Large language models show impressive capabilities. Are they just superficial statistics \u2013 or is there more to them?<\/strong><\/p>\n<p>Systems such as OpenAI\u2019s <a class=\"\" href=\"https:\/\/the-decoder.com\/openai-cuts-prices-for-gpt-3-by-two-thirds\/\">GPT-3<\/a> have shown that large language models have capabilities that can make them useful tools in areas as diverse as text processing and programming.<\/p>\n<p>With <a class=\"\" href=\"https:\/\/the-decoder.com\/chatgpt-is-a-gpt-3-chatbot-from-openai-that-you-can-test-now\/\">ChatGPT<\/a> the company has released a model that puts these capabilities in the hands of the general public, creating new challenges for educational institutions, for example.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Large language models show impressive capabilities. Are they just superficial statistics \u2013 or is there more to them? Systems such as OpenAI\u2019s GPT-3 have shown that large language models have capabilities that can make them useful tools in areas as diverse as text processing and programming. With ChatGPT the company has released a model that [\u2026]<\/p>\n","protected":false},"author":556,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32,6],"tags":[],"class_list":["post-156921","post","type-post","status-publish","format-standard","hentry","category-education","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/156921","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/556"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=156921"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/156921\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=156921"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=156921"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=156921"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}