Google Scientists Create AI That Can Generate Videos From One Frame
Google's DeepMind neural network has demonstrated that it can dream up short videos from a single image frame, and it's really cool to see how it works. As DeepMind noted on Twitter, the artificial intelligence model, named "Transframer" -- that's a riff on a "transformer," a common type of AI tool that whips up text based on partial prompts -- "excels in video prediction and view synthesis," and is able to "generate 30 [second] videos from a single image." Transframer is a general-purpose generative framework that can handle many image and video tasks in a probabilistic setting. New work shows it excels in video prediction and view synthesis, and can generate 30s videos from a single image: https://t.co/wX3nrrYEEa As the Transframer website notes, the AI makes its perspective videos by predicting the target images' surroundings with "context images" -- in short, by correctly guessing what one of the chairs below would look like from different perspectives based on extensive training data that lets it "imagine" an actual object from another angle.
Aug-18-2022, 16:00:11 GMT
- Technology: