{"id":150953,"date":"2022-11-24T02:24:11","date_gmt":"2022-11-24T08:24:11","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2022\/11\/building-interactive-agents-in-video-game-worlds"},"modified":"2022-11-24T02:24:11","modified_gmt":"2022-11-24T08:24:11","slug":"building-interactive-agents-in-video-game-worlds","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2022\/11\/building-interactive-agents-in-video-game-worlds","title":{"rendered":"Building interactive agents in video game worlds"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/building-interactive-agents-in-video-game-worlds2.jpg\"><\/a><\/p>\n<p>Human behaviour is remarkably complex. Even a simple request like, \u201c<a href=\"https:\/\/youtu.be\/fKb7ONh0l3s\" target=\"_blank\">Put the ball close to the box<\/a>\u201d still requires deep understanding of situated intent and language. The meaning of a word like \u2018close\u2019 can be difficult to pin down \u2013 placing the ball <em>inside<\/em> the box might technically be the closest, but it\u2019s likely the speaker wants the ball placed <em>next to<\/em> the box. For a person to correctly act on the request, they must be able to understand and judge the situation and surrounding context.<\/p>\n<p><iframe loading=\"lazy\" title=\"Put the ball close\/in the box\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/fKb7ONh0l3s?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/p>\n<p>Most artificial intelligence (AI) researchers now believe that writing computer code which can capture the nuances of situated interactions is impossible. Alternatively, modern machine learning (ML) researchers have focused on learning about these types of interactions from data. To explore these learning-based approaches and quickly build agents that can make sense of human instructions and safely perform actions in open-ended conditions, we created a research framework within a video game environment.<\/p>\n<p>Today, we\u2019re <a href=\"https:\/\/arxiv.org\/abs\/2211.11602\" target=\"_blank\">publishing a paper<\/a> and <a href=\"https:\/\/www.youtube.com\/playlist?list=PLJ1sthn_UneUQ2avq5yCVszcbmcmbege6\" target=\"_blank\">collection of videos<\/a>, showing our early steps in building video game AIs that can understand fuzzy human concepts \u2013 and therefore, can begin to interact with people on their own terms.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Human behaviour is remarkably complex. Even a simple request like, \u201cPut the ball close to the box\u201d still requires deep understanding of situated intent and language. The meaning of a word like \u2018close\u2019 can be difficult to pin down \u2013 placing the ball inside the box might technically be the closest, but it\u2019s likely the [\u2026]<\/p>\n","protected":false},"author":556,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1509,6],"tags":[],"class_list":["post-150953","post","type-post","status-publish","format-standard","hentry","category-entertainment","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/150953","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/556"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=150953"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/150953\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=150953"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=150953"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=150953"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}