{"id":160294,"date":"2023-03-14T20:23:20","date_gmt":"2023-03-15T01:23:20","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/03\/gpt-4"},"modified":"2023-03-14T20:23:20","modified_gmt":"2023-03-15T01:23:20","slug":"gpt-4","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/03\/gpt-4","title":{"rendered":"GPT-4"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/gpt-42.jpg\"><\/a><\/p>\n<p>Its Up!<\/p>\n<hr>\n<p>We\u2019ve created GPT-4, the latest milestone in OpenAI\u2019s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks. For example, it passes a simulated bar exam with a score around the top 10% of test takers; in contrast, GPT-3.5\u2019s score was around the bottom 10%. We\u2019ve spent 6 months iteratively <a href=\"https:\/\/openai.com\/research\/instruction-following\" rel=\"noopener noreferrer\" target=\"_blank\">aligning<\/a> GPT-4 using lessons from our adversarial testing program as well as ChatGPT, resulting in our best-ever results (though far from perfect) on factuality, steerability, and refusing to go outside of guardrails.<\/p>\n<p>Over the past two years, we rebuilt our entire deep learning stack and, together with Azure, co-designed a supercomputer from the ground up for our workload. A year ago, we trained GPT-3.5 as a first \u201ctest run\u201d of the system. We found and fixed some bugs and improved our theoretical foundations. As a result, our GPT-4 training run was (for us at least!) unprecedentedly stable, becoming our first large model whose training performance we were able to accurately predict ahead of time. As we continue to focus on reliable scaling, we aim to hone our methodology to help us predict and prepare for future capabilities increasingly far in advance\u2014something we view as critical for safety.<\/p>\n<p>We are releasing GPT-4\u2019s text input capability via ChatGPT and the API (with a <a href=\"https:\/\/openai.com\/waitlist\/gpt-4-api\" rel=\"noopener noreferrer\">waitlist<\/a>). To prepare the image input capability for wider availability, we\u2019re collaborating closely with a <a href=\"https:\/\/www.bemyeyes.com\/\" rel=\"noopener noreferrer\" target=\"_blank\">single partner<\/a> to start. We\u2019re also open-sourcing <a href=\"https:\/\/github.com\/openai\/evals\" rel=\"noopener noreferrer\" target=\"_blank\">OpenAI Evals<\/a>, our framework for automated evaluation of AI model performance, to allow anyone to report shortcomings in our models to help guide further improvements.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Its Up! We\u2019ve created GPT-4, the latest milestone in OpenAI\u2019s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks. For example, it passes a simulated [\u2026]<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,44],"tags":[],"class_list":["post-160294","post","type-post","status-publish","format-standard","hentry","category-robotics-ai","category-supercomputing"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/160294","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=160294"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/160294\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=160294"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=160294"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=160294"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}