{"id":176503,"date":"2023-11-22T14:23:12","date_gmt":"2023-11-22T20:23:12","guid":{"rendered":"https:\/\/lifeboat.com\/blog\/2023\/11\/the-ai-startup-behind-stable-diffusion-is-now-testing-generative-video"},"modified":"2023-11-22T14:23:12","modified_gmt":"2023-11-22T20:23:12","slug":"the-ai-startup-behind-stable-diffusion-is-now-testing-generative-video","status":"publish","type":"post","link":"https:\/\/lifeboat.com\/blog\/2023\/11\/the-ai-startup-behind-stable-diffusion-is-now-testing-generative-video","title":{"rendered":"The AI startup behind Stable Diffusion is now testing generative video"},"content":{"rendered":"<p><a class=\"aligncenter blog-photo\" href=\"https:\/\/lifeboat.com\/blog.images\/the-ai-startup-behind-stable-diffusion-is-now-testing-generative-video2.jpg\"><\/a><\/p>\n<p>Stable Diffusion\u2019s generative art can now be animated, developer Stability AI <a data-i13n=\"cpos:1;pos:1\" href=\"https:\/\/stability.ai\/research\/stable-video-diffusion-scaling-latent-video-diffusion-models-to-large-datasets\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk: announced;cpos:1;pos:1;elm: context_link;itc:0\" class=\"\">announced<\/a>. The company has released a new product called <a data-i13n=\"cpos:2;pos:1\" href=\"https:\/\/stability.ai\/news\/stable-video-diffusion-open-ai-video-model\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk: Stable Video Diffusion;cpos:2;pos:1;elm: context_link;itc:0\" class=\"\">Stable Video Diffusion<\/a> into a research preview, allowing users to create video from a single image. \u201cThis state-of-the-art generative AI video model represents a significant step in our journey toward creating models for everyone of every type,\u201d the company wrote.<\/p>\n<p>The new tool has been released in the form of two image-to-video models, each capable of generating 14 to 25 frames long at speeds between 3 and 30 frames per second at 576 \u00d7 1,024 resolution. It\u2019s capable of multi-view synthesis from a single frame with fine-tuning on multi-view datasets. \u201cAt the time of release in their foundational form, through external evaluation, we have found these models surpass the leading closed models in user preference studies,\u201d the company said, comparing it to text-to-video platforms <a data-i13n=\"cpos:3;pos:1\" href=\"https:\/\/www.engadget.com\/ai-film-festival-runway-ml-191033350.html\" data-ylk=\"slk: Runway;cpos:3;pos:1;elm: context_link;itc:0\" class=\"\">Runway<\/a> and <a data-i13n=\"cpos:4;pos:1\" href=\"https:\/\/www.pika.art\/\" rel=\"nofollow noopener\" target=\"_blank\" data-ylk=\"slk: Pika Labs;cpos:4;pos:1;elm: context_link;itc:0\" class=\"\">Pika Labs<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stable Diffusion\u2019s generative art can now be animated, developer Stability AI announced. The company has released a new product called Stable Video Diffusion into a research preview, allowing users to create video from a single image. \u201cThis state-of-the-art generative AI video model represents a significant step in our journey toward creating models for everyone of [\u2026]<\/p>\n","protected":false},"author":556,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-176503","post","type-post","status-publish","format-standard","hentry","category-robotics-ai"],"_links":{"self":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/176503","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/users\/556"}],"replies":[{"embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/comments?post=176503"}],"version-history":[{"count":0,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/posts\/176503\/revisions"}],"wp:attachment":[{"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/media?parent=176503"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/categories?post=176503"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lifeboat.com\/blog\/wp-json\/wp\/v2\/tags?post=176503"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}