We present an innovative approach for large-scale data collection in human-robot interaction research through the use of online multi-player games. By casting a robotic task as a collaborative game, we gather thousands of examples of human-human interactions online, and then leverage this corpus of action and dialog data to create contextually relevant, social and task-oriented behaviors for human-robot interaction in the real world. We demonstrate our work in a collaborative search and retrieval task requiring dialog, action synchronization and action sequencing between the human and robot partners. A user study performed at the Boston Museum of Science shows that the autonomous robot exhibits many of the same patterns of behavior that were observed in the online dataset and survey results rate the robot similarly to human partners in several critical measures.

While such systems have been shown to successfully support a broad range of interactions, they rely heavily on precoded data. For example, dialogue responses are typically limited to only one or two dozen phrases, which pales in comparison to the diversity of human speech. We believe that in order for robotic systems to become a truly ubiquitous technology, robots must make sense of natural human behavior and engage with humans in a more humanlike way. Robots must become more like humans instead of forcing humans to be more like robots. Much of human knowledge about the appropriateness of behavior, in terms of both speech and actions, comes from our personal experiences and our observations of others. We compare its performance variations form a knowledge base from which to a teleoperated robot following a scripted task we learn what to say and what actions to perform to protocol and examine both the behavior of the achieve certain goals.