{"id":159484,"date":"2023-03-03T19:26:52","date_gmt":"2023-03-04T01:26:52","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/03\/researchers-use-ai-to-generate-images-based-on-peoples-brain-activity"},"modified":"2023-03-03T19:26:52","modified_gmt":"2023-03-04T01:26:52","slug":"researchers-use-ai-to-generate-images-based-on-peoples-brain-activity","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/03\/researchers-use-ai-to-generate-images-based-on-peoples-brain-activity","title":{"rendered":"Researchers Use AI to Generate Images Based on People\u2019s Brain Activity"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/researchers-use-ai-to-generate-images-based-on-peoples-brain-activity3.jpg\"><\/a><\/p>\n<p>What if an AI could interpret your imagination, turning images in your mind\u2019s eye into reality? While that sounds like a detail in a cyberpunk novel, researchers have now accomplished exactly this, according to a recently-published paper.<\/p>\n<p>Researchers found that they could reconstruct high-resolution and highly accurate images from brain activity by using the popular Stable Diffusion image generation model, as outlined in <a href=\"https:\/\/www.biorxiv.org\/content\/10.1101\/2022.11.18.517004v2.full.pdf\" target=\"_blank\"> a paper<\/a> published in December. The authors wrote that unlike previous studies, they didn\u2019t need to train or fine-tune the AI models to create these images.<\/p>\n<p>The researchers\u2014from the Graduate School of Frontier Biosciences at Osaka University\u2014said that they first predicted a latent representation, which is a model of the image\u2019s data, from fMRI signals. Then, the model was processed and noise was added to it through the diffusion process. Finally, the researchers decoded text representations from fMRI signals within the higher visual cortex and used them as input to produce a final constructed image.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What if an AI could interpret your imagination, turning images in your mind\u2019s eye into reality? While that sounds like a detail in a cyberpunk novel, researchers have now accomplished exactly this, according to a recently-published paper. Researchers found that they could reconstruct high-resolution and highly accurate images from brain activity by using the popular [\u2026]<\/p>\n","protected":false},"author":599,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11,6],"tags":[],"class_list":["post-159484","post","type-post","status-publish","format-standard","hentry","category-biotech-medical","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/159484","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/599"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=159484"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/159484\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=159484"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=159484"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=159484"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}