New Algorithm Can Create Movies From Just a Few Snippets of Text

A new algorithm creates videos from text snippets. Researchers at Katholieke University Leuven in Belgium have developed an algorithm that creates videos from text snippets. The first stage of the process involves a "generator" neural network using text to produce a blurry image of the background with an unfocused blob where the main action occurs. The second stage derives a video from both this "gist" and the text, producing a short video. A second network functions as a "discriminator" during training by watching the generated video alongside a real video of the action described in the text, and is taught to pick the real one.