How Facebook plans to evaluate its quest for generalized artificial intelligence

One of the biggest misconceptions about artificial intelligence is the belief that today's AIs possess generalized intelligence. We are really good at leveraging large data sets to accomplish specific tasks, but fall flat at replicating the breadth of human intelligence. If we're going to move toward generalized intelligence, Facebook wants to make sure we know how to evaluate progress. In a paper, Facebook's AI Research (FAIR) lab outlines just that as part of its CommAI framework. First, the team argues that a proper generalized AI should be able to fluently communicate in natural language with humans. Researchers in the field of natural language processing have been working on the problem of human computer interaction through language for some time now, but we have a long way to go before our computational systems can rival humans.