AI already turns text prompts into stunning art. Next up: video

Runway has shouldered aside Midjourney and Stable Diffusion, introducing the first clips of text-to-video AI art that the company says is completely generated by a text prompt. The company said that it's offering a waitlist to join what it calls "Gen 2" of text-to-video AI, after offering a similar waitlist for its first, simpler text-to-video tools that use a real-world scene as a model. When AI art emerged last year, it used a text-to-image model. A user would input a text prompt describing the scene, and the tool would attempt to create an image using what it knew of real-world "seeds," artistic styles and so forth. Services like Midjourney perform these tasks on a cloud server, while Stable Diffusion and Stable Horde take advantage of similar AI models running on home PCs.