{"id":115611,"date":"2020-11-08T05:23:11","date_gmt":"2020-11-08T13:23:11","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2020\/11\/this-could-lead-to-the-next-big-breakthrough-in-common-sense-ai"},"modified":"2020-11-08T05:23:11","modified_gmt":"2020-11-08T13:23:11","slug":"this-could-lead-to-the-next-big-breakthrough-in-common-sense-ai","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2020\/11\/this-could-lead-to-the-next-big-breakthrough-in-common-sense-ai","title":{"rendered":"This could lead to the next big breakthrough in common sense AI"},"content":{"rendered":"

<\/a><\/p>\n

You\u2019ve probably heard us say this countless times: GPT-3, the gargantuan AI that spews uncannily human-like language, is a marvel. It\u2019s also largely a mirage<\/a>. You can tell with a simple trick: Ask it the color of sheep<\/a>, and it will suggest<\/a> \u201cblack\u201d as often as \u201cwhite\u201d\u2014reflecting the phrase \u201cblack sheep\u201d in our vernacular.<\/p>\n

That\u2019s the problem with language models: because they\u2019re only trained on text, they lack common sense. Now researchers from the University of North Carolina, Chapel Hill, have designed a new technique to change that. They call it \u201cvokenization,\u201d and it gives language models like GPT-3 the ability to \u201csee.\u201d<\/p>\n

It\u2019s not the first time people have sought to combine language models with computer vision. This is actually a rapidly growing area of AI research. The idea is that both types of AI have different strengths. Language models like GPT-3 are trained through unsupervised learning, which requires no manual data labeling, making them easy to scale. Image models like object recognition systems, by contrast, learn more directly from reality. In other words, their understanding doesn\u2019t rely on the kind of abstraction of the world that text provides. They can \u201csee\u201d from pictures of sheep that they are in fact white.<\/p>\n","protected":false},"excerpt":{"rendered":"

You\u2019ve probably heard us say this countless times: GPT-3, the gargantuan AI that spews uncannily human-like language, is a marvel. It\u2019s also largely a mirage. You can tell with a simple trick: Ask it the color of sheep, and it will suggest \u201cblack\u201d as often as \u201cwhite\u201d\u2014reflecting the phrase \u201cblack sheep\u201d in our vernacular. That\u2019s [\u2026]<\/p>\n","protected":false},"author":359,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1522,6],"tags":[],"class_list":["post-115611","post","type-post","status-publish","format-standard","hentry","category-innovation","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/115611","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/359"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=115611"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/115611\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=115611"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=115611"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=115611"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}