Learning When to Switch between Skills in a High Dimensional Domain

Skills are generally designed by a domain expert, but designing a `good' set of skills can be challenging in high-dimensional, complex domains. In some cases, the skills may contain useful prior knowledge but cannot solve the task, resulting in a sub-optimal solution or no solution at all. Given a `poor' set of skills, we would like to dynamically improve them. The main contribution of this paper is showing that Interrupting Options (IO) can improve the initial skill set in a high-dimensional, complex domain by learning when to switch between skills. Furthermore, we discuss some of the pitfalls we ran into while trying to get IO to work.