{"id":145357,"date":"2022-09-01T08:29:00","date_gmt":"2022-09-01T13:29:00","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2022\/09\/using-ai-to-decode-speech-from-brain-activity"},"modified":"2022-09-01T08:29:00","modified_gmt":"2022-09-01T13:29:00","slug":"using-ai-to-decode-speech-from-brain-activity","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2022\/09\/using-ai-to-decode-speech-from-brain-activity","title":{"rendered":"Using AI to decode speech from brain activity"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/using-ai-to-decode-speech-from-brain-activity.gif\"><\/a><\/p>\n<p>Every year, more than 69 million people around the world suffer traumatic brain injury, which leaves many of them unable to communicate through speech, typing, or gestures. These people\u2019s lives could dramatically improve if researchers developed a technology to decode language directly from noninvasive brain recordings. Today, we\u2019re sharing research that takes a step toward this goal. We\u2019ve developed an AI model that can decode speech from noninvasive recordings of brain activity.<\/p>\n<p>From three seconds of brain activity, our results show that our model can decode the corresponding speech segments with up to 73 percent top-10 accuracy from a vocabulary of 793 words, i.e., a large portion of the words we typically use on a day-to-day basis.<\/p>\n<p>Decoding speech from brain activity has been a long-standing goal of neuroscientists and clinicians, but most of the progress has relied on invasive brain-recording techniques, such as <a class=\"\" href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/31865060\/\" rel=\"noopener nofollow\" target=\"_blank\" data-ms=\"{\u201ccreative\u201d:\u201d link\u201d,\u201d creative_detail\u201d:\u201d link\u201d,\u201d create_type\u201d:\u201d link\u201d,\u201d create_type_detail\u201d:\u201d link\u201d}\" data-lynx-mode=\"asynclazy\"> stereotactic electroencephalography<\/a> and <a class=\"\" href=\"https:\/\/en.wikipedia.org\/wiki\/Electrocorticography\" rel=\"noopener nofollow\" target=\"_blank\" data-ms=\"{\u201ccreative\u201d:\u201d link\u201d,\u201d creative_detail\u201d:\u201d link\u201d,\u201d create_type\u201d:\u201d link\u201d,\u201d create_type_detail\u201d:\u201d link\u201d}\" data-lynx-mode=\"asynclazy\"> electrocorticography<\/a>. These devices provide clearer signals than noninvasive methods but require neurosurgical interventions. While results from that work suggest that decoding speech from recordings of brain activity is feasible, decoding speech with noninvasive approaches would provide a safer, more scalable solution that could ultimately benefit many more people. This is very challenging, however, since noninvasive recordings are notoriously noisy and can greatly vary across recording sessions and individuals for a variety of reasons, including differences in each person\u2019s brain and where the sensors are placed.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Every year, more than 69 million people around the world suffer traumatic brain injury, which leaves many of them unable to communicate through speech, typing, or gestures. These people\u2019s lives could dramatically improve if researchers developed a technology to decode language directly from noninvasive brain recordings. Today, we\u2019re sharing research that takes a step toward [\u2026]<\/p>\n","protected":false},"author":556,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-145357","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/145357","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/556"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=145357"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/145357\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=145357"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=145357"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=145357"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}