Making Robotic Sense of Incomplete Human Instructions in High-Level Programming for Industrial Robotic Assembly

In this paper we describe our NLP supported programming-by-demonstration approach to high-level robot programming that allows users to generate skills and robot program primitives for later refinement and re-use. Our ideas incorporate the identification of common user strategies (interaction patterns) in the programming process, which can be exploited to support a human user in establishing common ground with a robotic system. We have evaluated a prototype implementation of this approach in a user study and use observations from this study to define further research efforts, which we discuss in this short paper.