#
0 likes118 views
Categories Uncategorized

Text-to-video AI inches closer as startup Runway announces new model

Author March 20, 2023
AI-generated footage of “A shot following a hiker through jungle brush.” The video is not photorealistic and appears smeared and blurry.
An example video generated by Runway’s Gen-2 model. The text input prompt was “A shot following a hiker through jungle brush.” | Image: Runway

Text-to-image AI is mainstream now, but just waiting in the wings is text-to-video. The pitch for this technology is that you’ll be able to type a description and generate a corresponding video in any style you like. Current capabilities lag behind this dream, but for those tracking the tech’s progress, an announcement today by AI startup Runway of a new AI video generation model is noteworthy nonetheless.

Runway offers a web-based video editor that specializes in AI tools like background removal and pose detection. The company helped develop open-source text-to-image model Stable Diffusion and announced its first AI video editing model, Gen-1, in February.

Gen-1 focused on transforming existing video footage, letting users input a…

Continue reading…