Our research seeks to enable social robots to ask intelligent questions when learning tasks from human teachers. We use the paradigm of Learning from Demonstration (LfD) to address the problem of efficient learning of task policies by example (Chernova and Thomaz 2014). In this work, we explore how to leverage human domain knowledge for task model construction, by allowing users to directly select a set of the salient features for classification of objects used in the task being demonstrated.

Our work is aimed at service robots deployed in human environments that will need many specialized object manipulation skill. We believe robots should leverage end-users to quickly and efficiently learn the affordances of objects in their environment. Prior work has shown that this approach is promising because people naturally focus on showing salient rare aspects ofthe objects (Thomaz and Cakmak 2009). We replicate these prior results and build on them to create a semi-supervised combination of self and guided learning.We compare three conditions: (1) learning through self-exploration, (2) learning from demonstrations providedby 10 naive users, and (3) self-exploration seeded with the user demonstrations. Initial results suggests benefits of a mixed initiative approach.

In this book, we provide an introduction to the field of Learning from Demonstration with a focus on the unique technical challenges associated with designing robots that learn from naive human teachers. The field of LfD has grown into an extensive body of literature over the past 30 years, with a wide variety of approaches for encoding human demonstrations and modeling skills and tasks. ISBN 9781627051996, 121 pages.

A long term goal of Interactive Reinforcement Learning is to incorporate non-expert human feedback to solve complex tasks. State-of-the-art methods have approached this problem by mapping human information to reward and value signals to indicate preferences and then iterating over them to compute the necessary control policy. In this paper we argue for an alternate, more effective characterization of human feedback: Policy Shaping. We introduce Advise, a Bayesian approach that attempts to maximize the information gained from human feedback by utilizing it as direct labels on the policy. We compare Advise to state-of-the-art approaches and highlight scenarios where it outperforms them and importantly is robust to infrequent and inconsistent human feedback.

In this article we report on the exhibits and challenges shown at the AAAI 2011 Robotics Program in San Francisco. The event included a broad demonstration of innovative research at the intersection of robotics and artificial intelligence. Through these multi-year challenge events, our goal has been to focus the research community's energy toward common platforms and common problems to work toward the greater goal of embodied AI.

On the day before the exhibition the participants convened a workshop of 18 short talks. Each track's exhibitors presented a summary of their exhibit. In addition, four guest speakers provided a broader context for all of the exhibitors' efforts. The first guest speaker was the National Science Foundation's Sven Koenig, who highlighted several federal programs that support projects in embodied intelligence. Koenig also provided insights into some of these program's specific priorities, such as international collaborations and educational engagement.

Turn-taking is a fundamental part of human communication. Our goal is to devise a turn-taking framework for human-robot interaction that, like the human skill, represents something fundamental about interaction, generic to context or domain. We propose a model of turn-taking, and conduct an experiment with human subjects to inform this model. Our findings from this study suggest that information flow is an integral part of human floor-passing behavior.

Turn-taking is a fundamental part of human communication. Our goal is to devise a turn-taking framework for human-robot interaction that, like the human skill, represents something fundamental about interaction, generic to context or domain. We propose a model of turn-taking, and conduct an experiment with human subjects to inform this model. Our findings from this study suggest that information flow is an integral part of human floor-passing behavior. Following this, we implement autonomous floor relinquishing on a robot and discuss our insights into the nature of a general turn-taking model for human-robot interaction.

The 19th robotics program at the annual AAAI conference was held in Atlanta, Georgia in July 2010. In this article we give a summary of three components of the exhibition: small scale manipulation challenge: robotic chess; the learning by demonstration challenge, and the education track. We also describe the participating teams, highlight the research questions they tackled and briefly describe the systems they demonstrated.

This year, the Robotics Exhibition included two such robotics challenge problems: manipulation and learning by demonstration. In the Small-Scale Manipulation Challenge four teams demonstrated systems playing robotic chess. This exhibit was organized by David Touretzky and Monica D. Anderson. In the Learning by Demonstration Challenge, three teams demonstrated systems learning a block-sorting task. This exhibit was organized by Sonia Chernova. Additionally, this year marked another successful turnout for the Robotics Education Track, organized by Zachary Dodds, which highlights student-and educator-led robotics projects. In this article we give a summary of these three components of the exhibition.