GPU-Trained System Understands Movies

Researchers from Karlsruhe Institute of Tech, MIT and University of Toronto published MovieQA, a dataset that contains 7702 reasoning questions and answers from 294 movies. Their innovative dataset and accuracy metrics provide a well-defined challenge for question/answer machine learning algorithms. The questions range from simpler'Who' did'What' to'Whom' that can be solved by computer vision alone, to'Why' and'How' something happened in the movie, questions that can only be solved by exploiting both the visual information and dialogs. MovieQA is unique in that it contains multiple sources of information – full-length movies, plot synopses, subtitles, scripts and DVS (a service that narrates moves scenes to the visually impaired). With the need to scale to large vocabulary data sets, they relied on a TITAN Black GPU for their overwhelming amount of training data.