{"id":178758,"date":"2023-12-20T16:26:31","date_gmt":"2023-12-20T22:26:31","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/12\/this-ai-transformer-tech-powered-robot-taught-itself-to-walk"},"modified":"2023-12-20T16:26:31","modified_gmt":"2023-12-20T22:26:31","slug":"this-ai-transformer-tech-powered-robot-taught-itself-to-walk","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/12\/this-ai-transformer-tech-powered-robot-taught-itself-to-walk","title":{"rendered":"This AI transformer tech-powered robot taught itself to walk"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/this-ai-transformer-tech-powered-robot-taught-itself-to-walk2.jpg\"><\/a><\/p>\n<p>The robot is blind and cannot see its environment but can continue to balance and walk, even if an object is hurled at it.<\/p>\n<hr>\n<p>UC researchers Ilija Radosavovic and Bike Zhang wondered if \u201creinforcement learning,\u201d a concept made popular by large language models (LLMs) last year, could also teach the robot how to adapt to changing needs. To test their theory, the duo started with one of the most basic functions humans can perform \u2014 walking.<\/p>\n<p><b>Transformer model for learning<\/b><\/p>\n<p>The researchers started in the simulation world, running billions of scenarios in Isaac Gym, a high-performance GPU-based physics simulation environment. The algorithm in the simulator rewarded actions that mimicked human-like walking while punishing the ones that didn\u2019t. Once the simulation perfected the task, it was transferred to a real-world humanoid bot that did not require further fine-tuning.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The robot is blind and cannot see its environment but can continue to balance and walk, even if an object is hurled at it. UC researchers Ilija Radosavovic and Bike Zhang wondered if \u201creinforcement learning,\u201d a concept made popular by large language models (LLMs) last year, could also teach the robot how to adapt to [\u2026]<\/p>\n","protected":false},"author":578,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,219,6],"tags":[],"class_list":["post-178758","post","type-post","status-publish","format-standard","hentry","category-information-science","category-physics","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/178758","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/578"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=178758"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/178758\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=178758"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=178758"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=178758"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}