{"id":199366,"date":"2024-11-13T02:27:03","date_gmt":"2024-11-13T08:27:03","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2024\/11\/virtual-training-uses-generative-ai-to-teach-robots-how-to-traverse-real-world-terrain"},"modified":"2024-11-13T02:27:03","modified_gmt":"2024-11-13T08:27:03","slug":"virtual-training-uses-generative-ai-to-teach-robots-how-to-traverse-real-world-terrain","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2024\/11\/virtual-training-uses-generative-ai-to-teach-robots-how-to-traverse-real-world-terrain","title":{"rendered":"Virtual training uses generative AI to teach robots how to traverse real world terrain"},"content":{"rendered":"<p><\/p>\n<p><iframe style=\"display: block; margin: 0 auto; width: 100%; aspect-ratio: 4\/3; object-fit: contain;\" src=\"https:\/\/www.youtube.com\/embed\/Xf-1zvt-4n8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope;\n   picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>MIT CSAIL researchers have developed a generative AI system, LucidSim, to train robots in virtual environments for real-world navigation. Using ChatGPT and physics simulators, robots learn to traverse complex terrains. This method outperforms traditional training, suggesting a new direction for robotic training.<\/p>\n<hr>\n<p>A team of roboticists and engineers at MIT CSAIL, Institute for AI and Fundamental Interactions, has developed a generative AI approach to teaching robots how to traverse terrain and move around objects in the real world.<\/p>\n<p>The group has published a <a href=\"https:\/\/arxiv.org\/abs\/2411.00083\" target=\"_blank\">paper<\/a> describing their work and possible uses for it on the <i>arXiv<\/i> preprint server. They also presented their ideas at the recent Conference on Robot Learning (<a href=\"https:\/\/www.corl.org\/\" target=\"_blank\">CORL 2024<\/a>), held in Munich Nov. 6\u20139.<\/p>\n<p>Getting robots to navigate in the real world at some point involves teaching them to learn on the fly, or by training them with videos of similar robots in a real-world environment. While such training has proven to be effective in limited environments, it tends to fail when a robot encounters something novel. In this new effort, the team at MIT developed virtual training that better translates to the real world.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>MIT CSAIL researchers have developed a generative AI system, LucidSim, to train robots in virtual environments for real-world navigation. Using ChatGPT and physics simulators, robots learn to traverse complex terrains. This method outperforms traditional training, suggesting a new direction for robotic training. A team of roboticists and engineers at MIT CSAIL, Institute for AI and [\u2026]<\/p>\n","protected":false},"author":650,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[219,6,1879],"tags":[],"class_list":["post-199366","post","type-post","status-publish","format-standard","hentry","category-physics","category-robotics-ai","category-virtual-reality"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/199366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/650"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=199366"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/199366\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=199366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=199366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=199366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}