{"id":157673,"date":"2023-02-11T14:24:15","date_gmt":"2023-02-11T20:24:15","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/02\/scientists-made-a-mind-bending-discovery-about-how-ai-actually-works"},"modified":"2023-02-11T14:24:15","modified_gmt":"2023-02-11T20:24:15","slug":"scientists-made-a-mind-bending-discovery-about-how-ai-actually-works","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/02\/scientists-made-a-mind-bending-discovery-about-how-ai-actually-works","title":{"rendered":"Scientists Made a Mind-Bending Discovery About How AI Actually Works"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/scientists-made-a-mind-bending-discovery-about-how-ai-actually-works2.jpg\"><\/a><\/p>\n<p>Researchers are starting to unravel one of the biggest mysteries behind the AI language models that power text and image generation tools like DALL-E and ChatGPT.<\/p>\n<p>For a while now, machine learning experts and scientists have noticed something strange about large language models (LLMs) like <a href=\"https:\/\/www.vice.com\/en\/article\/v7gawa\/openai-exclusively-licensed-its-language-generating-software-to-microsoft\"> OpenAI\u2019s GPT-3<\/a> and <a href=\"https:\/\/www.vice.com\/en\/article\/3ad8gk\/googles-ai-isnt-sentient-but-it-is-biased-and-terrible\"> Google\u2019s LaMDA<\/a> : they are inexplicably good at carrying out tasks that they haven\u2019t been specifically trained to perform. It\u2019s a perplexing question, and just one example of how it can be difficult, if not impossible in most cases, <a href=\"https:\/\/www.vice.com\/en\/article\/y3pezm\/scientists-increasingly-cant-explain-how-ai-works\"> to explain how an AI model arrives at its outputs<\/a> in fine-grained detail.<\/p>\n<p>In a <a href=\"https:\/\/arxiv.org\/pdf\/2211.15661.pdf\" target=\"_blank\"> forthcoming study<\/a> posted to the arXiv preprint server, researchers at the Massachusetts Institute of Technology, Stanford University, and Google explore this \u201capparently mysterious\u201d phenomenon, which is called \u201cin-context learning.\u201d Normally, to accomplish a new task, most machine learning models need to be retrained on new data, a process that can normally require researchers to input thousands of data points to get the output they desire\u2014a tedious and time-consuming endeavor.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers are starting to unravel one of the biggest mysteries behind the AI language models that power text and image generation tools like DALL-E and ChatGPT. For a while now, machine learning experts and scientists have noticed something strange about large language models (LLMs) like OpenAI\u2019s GPT-3 and Google\u2019s LaMDA : they are inexplicably good [\u2026]<\/p>\n","protected":false},"author":661,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-157673","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/157673","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/661"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=157673"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/157673\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=157673"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=157673"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=157673"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}