{"id":187452,"date":"2024-04-15T22:24:05","date_gmt":"2024-04-16T03:24:05","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2024\/04\/ai-now-beats-humans-at-basic-tasks-new-benchmarks-are-needed-says-major-report"},"modified":"2024-04-15T22:24:05","modified_gmt":"2024-04-16T03:24:05","slug":"ai-now-beats-humans-at-basic-tasks-new-benchmarks-are-needed-says-major-report","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2024\/04\/ai-now-beats-humans-at-basic-tasks-new-benchmarks-are-needed-says-major-report","title":{"rendered":"AI now beats humans at basic tasks \u2014 new benchmarks are needed, says major report"},"content":{"rendered":"

<\/a><\/p>\n

Artificial intelligence (AI) systems, such as the chatbot ChatGPT<\/a>, have become so advanced that they now very nearly match or exceed human performance in tasks including reading comprehension, image classification and competition-level mathematics, according to a new report (see \u2018Speedy advances\u2019). Rapid progress in the development of these systems also means that many common benchmarks and tests for assessing them are quickly becoming obsolete.<\/p>\n

These are just a few of the top-line findings from the Artificial Intelligence Index Report 2024<\/i><\/a>, which was published on 15 April by the Institute for Human-Centered Artificial Intelligence at Stanford University in California. The report charts the meteoric progress in machine-learning systems over the past decade.<\/p>\n

In particular, the report says, new ways of assessing AI \u2014 for example, evaluating their performance on complex tasks, such as abstraction and reasoning \u2014 are more and more necessary. \u201cA decade ago, benchmarks would serve the community for 5\u201310 years\u201d whereas now they often become irrelevant in just a few years, says Nestor Maslej, a social scientist at Stanford and editor-in-chief of the AI Index. \u201cThe pace of gain has been startlingly rapid.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

Artificial intelligence (AI) systems, such as the chatbot ChatGPT, have become so advanced that they now very nearly match or exceed human performance in tasks including reading comprehension, image classification and competition-level mathematics, according to a new report (see \u2018Speedy advances\u2019). Rapid progress in the development of these systems also means that many common benchmarks [\u2026]<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2229,6],"tags":[],"class_list":["post-187452","post","type-post","status-publish","format-standard","hentry","category-mathematics","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/187452","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=187452"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/187452\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=187452"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=187452"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=187452"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}