Showing versus doing: Teaching by demonstration

Ho, Mark K., Littman, Michael, MacGlashan, James, Cushman, Fiery, Austerweil, Joseph L.

Neural Information Processing Systems 

People often learn from others' demonstrations, and classic inverse reinforcement learning (IRL) algorithms have brought us closer to realizing this capacity in machines. In contrast, teaching by demonstration has been less well studied computationally. Here, we develop a novel Bayesian model for teaching by demonstration. Stark differences arise when demonstrators are intentionally teaching a task versus simply performing a task. In two experiments, we show that human participants systematically modify their teaching behavior consistent with the predictions of our model.