{"id":147237,"date":"2022-09-29T23:23:27","date_gmt":"2022-09-30T04:23:27","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2022\/09\/metas-new-make-a-video-ai-can-generate-quick-movie-clips-from-text-prompts"},"modified":"2022-09-29T23:23:27","modified_gmt":"2022-09-30T04:23:27","slug":"metas-new-make-a-video-ai-can-generate-quick-movie-clips-from-text-prompts","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2022\/09\/metas-new-make-a-video-ai-can-generate-quick-movie-clips-from-text-prompts","title":{"rendered":"Meta\u2019s new Make-a-Video AI can generate quick movie clips from text prompts"},"content":{"rendered":"

<\/a><\/p>\n

Meta unveiled its Make-a-Scene<\/a> text-to-image generation AI in July, which like Dall-E<\/a> and Midjourney<\/a>, utilizes machine learning algorithms (and massive databases of scraped online artwork<\/a>) to create fantastical depictions of written prompts. On Thursday, Meta CEO Mark Zuckerberg revealed Make-a-Scene\u2019s more animated contemporary, Make-a-Video.<\/p>\n

As its name implies, Make-a-Video is, \u201ca new AI system that lets people turn text prompts into brief, high-quality video clips,\u201d Zuckerberg wrote in a Meta blog Thursday. Functionally, Video works the same way that Scene does \u2014 relying on a mix of natural language processing and generative neural networks to convert non-visual prompts into images \u2014 it\u2019s just pulling content in a different format.<\/p>\n

\u201cOur intuition is simple: learn what the world looks like and how it is described from paired text-image data, and learn how the world moves from unsupervised video footage,\u201d a team of Meta researchers wrote in a research paper published Thursday morning. Doing so enabled the team to reduce the amount of time needed to train the Video model and eliminate the need for paired text-video data, while preserving \u201cthe vastness (diversity in aesthetic, fantastical depictions, etc.) of today\u2019s image generation models.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

Meta unveiled its Make-a-Scene text-to-image generation AI in July, which like Dall-E and Midjourney, utilizes machine learning algorithms (and massive databases of scraped online artwork) to create fantastical depictions of written prompts. On Thursday, Meta CEO Mark Zuckerberg revealed Make-a-Scene\u2019s more animated contemporary, Make-a-Video. As its name implies, Make-a-Video is, \u201ca new AI system that [\u2026]<\/p>\n","protected":false},"author":396,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[41,6],"tags":[],"class_list":["post-147237","post","type-post","status-publish","format-standard","hentry","category-information-science","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/147237","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/396"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=147237"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/147237\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=147237"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=147237"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=147237"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}