{"id":191568,"date":"2024-06-21T14:29:14","date_gmt":"2024-06-21T19:29:14","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2024\/06\/rohm-here-are-6%ef%b8%8f%e2%83%a3-research-papers-to-add-to-your-reading-list-from-ai-researchers-at-meta-at-cvpr-2024"},"modified":"2024-06-21T14:29:14","modified_gmt":"2024-06-21T19:29:14","slug":"rohm-here-are-6%ef%b8%8f%e2%83%a3-research-papers-to-add-to-your-reading-list-from-ai-researchers-at-meta-at-cvpr-2024","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2024\/06\/rohm-here-are-6%ef%b8%8f%e2%83%a3-research-papers-to-add-to-your-reading-list-from-ai-researchers-at-meta-at-cvpr-2024","title":{"rendered":"RoHM: Here are 6\ufe0f\u20e3 research papers to add to your reading list from AI researchers at Meta at CVPR 2024"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/rohm3.jpg\"><\/a><\/p>\n<p><iframe style=\"display: block; margin: 0 auto; width: 100%; aspect-ratio: 4\/3; object-fit: contain;\" src=\"https:\/\/www.youtube.com\/embed\/hX7yO2c1hEE?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope;\n   picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>\u2022 Relightable Gaussian Codec Avatars \u27a1\ufe0f <a href=\"https:\/\/go.fb.me\/gdtkjm\">https:\/\/go.fb.me\/gdtkjm<\/a> \u2022 URHand: Universal Relightable Hands \u27a1\ufe0f <a href=\"https:\/\/go.fb.me\/1lmv7o\">https:\/\/go.fb.me\/1lmv7o<\/a> \u2022 RoHM: Robust Human Motion Reconstruction via Diffusion \u27a1\ufe0f <a href=\"https:\/\/www.youtube.com\/embed\/hX7yO2c1hEE\">https:\/\/www.youtube.com\/embed\/hX7yO2c1hEE<\/a><\/p>\n<hr>\n<p>RoHM is a novel diffusion-based motion model that, conditioned on noisy and occluded input data, reconstructs complete, plausible motions in consistent global coordinates. Given the complexity of the problem \u2014 requiring one to address different tasks (denoising and infilling) in different solution spaces (local and global motion) \u2014 we decompose it into two sub-tasks and learn two models, one for global trajectory and one for local motion. To capture the correlations between the two, we then introduce a novel conditioning module, combining it with an iterative inference scheme. We apply RoHM to a variety of tasks \u2014 from motion reconstruction and denoising to spatial and temporal infilling. Extensive experiments on three popular datasets show that our method outperforms state-of-the-art approaches qualitatively and quantitatively, while being faster at test time.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u2022 Relightable Gaussian Codec Avatars \u27a1\ufe0f https:\/\/go.fb.me\/gdtkjm \u2022 URHand: Universal Relightable Hands \u27a1\ufe0f https:\/\/go.fb.me\/1lmv7o \u2022 RoHM: Robust Human Motion Reconstruction via Diffusion \u27a1\ufe0f https:\/\/www.youtube.com\/embed\/hX7yO2c1hEE RoHM is a novel diffusion-based motion model that, conditioned on noisy and occluded input data, reconstructs complete, plausible motions in consistent global coordinates. Given the complexity of the problem \u2014 requiring [\u2026]<\/p>\n","protected":false},"author":709,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-191568","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/191568","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/709"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=191568"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/191568\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=191568"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=191568"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=191568"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}