{"id":172234,"date":"2023-09-17T15:22:22","date_gmt":"2023-09-17T20:22:22","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/09\/deepmind-discovers-that-ai-large-language-models-can-optimize-their-own-prompts"},"modified":"2023-09-17T15:22:22","modified_gmt":"2023-09-17T20:22:22","slug":"deepmind-discovers-that-ai-large-language-models-can-optimize-their-own-prompts","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/09\/deepmind-discovers-that-ai-large-language-models-can-optimize-their-own-prompts","title":{"rendered":"DeepMind discovers that AI large language models can optimize their own prompts"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/deepmind-discovers-that-ai-large-language-models-can-optimize-their-own-prompts2.jpg\"><\/a><\/p>\n<p>When people program new <a href=\"https:\/\/www.edureka.co\/blog\/what-is-deep-learning\" target=\"_blank\" rel=\"noreferrer noopener\">deep learning AI models<\/a> \u2014 those that can focus on the right features of data by themselves \u2014 the vast majority rely on optimization algorithms, or <a href=\"https:\/\/www.scaler.com\/topics\/deep-learning\/optimizers-in-deep-learning\/\" target=\"_blank\" rel=\"noreferrer noopener\">optimizers<\/a>, to ensure the models have a high enough rate of accuracy. But one of the most commonly used optimizers \u2014 derivative-based optimizers\u2014 run into trouble handling real-world applications.<\/p>\n<p>In a <a href=\"https:\/\/arxiv.org\/abs\/2309.03409\">new paper<\/a>, researchers from DeepMind propose a new way: Optimization by PROmpting (OPRO), a method that uses AI large language models (LLM) as optimizers. The unique aspect of this approach is that the optimization task is defined in natural language rather than through formal mathematical definitions.<\/p>\n<p>The researchers write, \u201cInstead of formally defining the optimization problem and deriving the update step with a programmed solver, we describe the optimization problem in natural language, then instruct the LLM to iteratively generate new solutions based on the problem description and the previously found solutions.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When people program new deep learning AI models \u2014 those that can focus on the right features of data by themselves \u2014 the vast majority rely on optimization algorithms, or optimizers, to ensure the models have a high enough rate of accuracy. But one of the most commonly used optimizers \u2014 derivative-based optimizers\u2014 run into [\u2026]<\/p>\n","protected":false},"author":556,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,2229,6],"tags":[],"class_list":["post-172234","post","type-post","status-publish","format-standard","hentry","category-information-science","category-mathematics","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/172234","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/556"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=172234"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/172234\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=172234"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=172234"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=172234"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}