We present an innovative approach for large-scale data collection in human-robot interaction research through the use of online multi-player games. By casting a robotic task as a collaborative game, we gather thousands of examples of human-human interactions online, and then leverage this corpus of action and dialog data to create contextually relevant, social and task-oriented behaviors for human-robot interaction in the real world. We demonstrate our work in a collaborative search and retrieval task requiring dialog, action synchronization and action sequencing between the human and robot partners. A user study performed at the Boston Museum of Science shows that the autonomous robot exhibits many of the same patterns of behavior that were observed in the online dataset and survey results rate the robot similarly to human partners in several critical measures.

This special issue of AI Magazine on dialog with robots brings together a collection of articles on situated dialog. The contributing authors have been working in interrelated fields of human-robot interaction, dialog systems, virtual agents, and other related areas and address core concepts in spoken dialog with embodied robots or agents. Several of the contributors participated in the AAAI Fall Symposium on Dialog with Robots, held in November 2010, and several articles in this issue are extensions of work presented there. The articles in this collection address diverse aspects of dialog with robots, but are unified in addressing opportunities with spoken language interaction, physical embodiment, and enriched representations of context.

Believability of characters has been an objective in literature, theater, film, and animation. We argue that believable robot characters are important in human-robot interaction, as well. In particular, we contend that believable characters evoke users' social responses that, for some tasks, lead to more natural interactions and are associated with improved task performance. In a dialogue-capable robot, a key to such believability is the integration of a consistent storyline, verbal and nonverbal behaviors, and sociocultural context.

Modeling interaction with robots raises new and different challenges for dialog modeling than traditional dialog modeling with less embodied machines. We present four case studies of implementing a typical human-robot interaction scenario with different state-of-the-art dialog frameworks in order to identify challenges and pitfalls specific to HRI and potential solutions. The results are discussed with a special focus on the interplay between dialog and task modeling on robots.

Many human social exchanges and coordinated activities critically involve dialogue interactions. Hence, we need to develop natural humanlike dialogue processing mechanisms for future robots if they are to interact with humans in natural ways. In this article we discuss the challenges of designing such flexible dialogue-based robotic systems. We report results from data we collected in human interaction experiments in the context of a search task and show how we can use these results to build more flexible robotic architectures that are starting to address the challenges of task-based humanlike natural language dialogues on robots.

Turn-taking is a fundamental part of human communication. Our goal is to devise a turn-taking framework for human-robot interaction that, like the human skill, represents something fundamental about interaction, generic to context or domain. We propose a model of turn-taking, and conduct an experiment with human subjects to inform this model. Our findings from this study suggest that information flow is an integral part of human floor-passing behavior.

Winter news from the Association for Advancement of Artificial Intelligence. Includes the Independent Auditor's Report.

The 7th International Conference on Intelligent Environments (IE11) was held July 25–28 2011 at the Nottingham Trent University, Nottingham, UK. The general chairs were Ahmad Lotfi (Nottingham Trent University), and Sean Hanna (Bartlett School of Graduate Studies, University College London). Juan Carlos Augusto (University of Ulster) and Achilles Kameas (Hellenic Open University and Computer Technology Institute), served as program chairs. This article presents a report of the conference.

Modeling interaction with robots raises new and different challenges for dialog modeling than traditional dialog modeling with less embodied machines. We present four case studies of implementing a typical human-robot interaction scenario with different state-of-the-art dialog frameworks in order to identify challenges and pitfalls specific to HRI and potential solutions. The results are discussed with a special focus on the interplay between dialog and task modeling on robots.

While such systems have been shown to successfully support a broad range of interactions, they rely heavily on precoded data. For example, dialogue responses are typically limited to only one or two dozen phrases, which pales in comparison to the diversity of human speech. We believe that in order for robotic systems to become a truly ubiquitous technology, robots must make sense of natural human behavior and engage with humans in a more humanlike way. Robots must become more like humans instead of forcing humans to be more like robots. Much of human knowledge about the appropriateness of behavior, in terms of both speech and actions, comes from our personal experiences and our observations of others. We compare its performance variations form a knowledge base from which to a teleoperated robot following a scripted task we learn what to say and what actions to perform to protocol and examine both the behavior of the achieve certain goals.