{"id":213755,"date":"2025-05-11T01:08:30","date_gmt":"2025-05-11T06:08:30","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2025\/05\/ai-powered-headphones-offer-group-translation-with-voice-cloning-and-3d-spatial-audio"},"modified":"2025-05-11T01:08:30","modified_gmt":"2025-05-11T06:08:30","slug":"ai-powered-headphones-offer-group-translation-with-voice-cloning-and-3d-spatial-audio","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2025\/05\/ai-powered-headphones-offer-group-translation-with-voice-cloning-and-3d-spatial-audio","title":{"rendered":"AI-powered headphones offer group translation with voice cloning and 3D spatial audio"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/ai-powered-headphones-offer-group-translation-with-voice-cloning-and-3d-spatial-audio3.jpg\"><\/a><\/p>\n<p>Tuochao Chen, a University of Washington doctoral student, recently toured a museum in Mexico. Chen doesn\u2019t speak Spanish, so he ran a translation app on his phone and pointed the microphone at the tour guide. But even in a museum\u2019s relative quiet, the surrounding noise was too much. The resulting text was useless.<\/p>\n<p><iframe style=\"display: block; margin: 0 auto; width: 100%; aspect-ratio: 4\/3; object-fit: contain;\" src=\"https:\/\/www.youtube.com\/embed\/unjqaCCbTrk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope;\n   picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>Various technologies have emerged lately promising fluent translation, but none of these solved Chen\u2019s problem of <a href=\"https:\/\/techxplore.com\/tags\/public+spaces\/\" rel=\"tag\" class=\"\">public spaces<\/a>. Meta\u2019s new glasses, for instance, function only with an isolated speaker; they <a href=\"https:\/\/www.youtube.com\/watch?v=unjqaCCbTrk\" target=\"_blank\">play an automated voice translation<\/a> after the speaker finishes.<\/p>\n<p>Now, Chen and a team of UW researchers have designed <a href=\"http:\/\/babelfish.cs.washington.edu\" target=\"_blank\">a headphone system that translates several speakers<\/a> at once, while preserving the direction and qualities of people\u2019s voices. The team built the system, called Spatial Speech Translation, with off-the-shelf noise-canceling headphones fitted with microphones. The team\u2019s algorithms separate out the different speakers in a space and follow them as they move, translate their speech and play it back with a 2\u20134 second delay.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tuochao Chen, a University of Washington doctoral student, recently toured a museum in Mexico. Chen doesn\u2019t speak Spanish, so he ran a translation app on his phone and pointed the microphone at the tour guide. But even in a museum\u2019s relative quiet, the surrounding noise was too much. The resulting text was useless. Various technologies [\u2026]<\/p>\n","protected":false},"author":367,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,41,1512],"tags":[],"class_list":["post-213755","post","type-post","status-publish","format-standard","hentry","category-biotech-medical","category-information-science","category-mobile-phones"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/213755","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/367"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=213755"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/213755\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=213755"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=213755"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=213755"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}