Minimum Description Length Control

In order to learn efficiently in a complex world with multiple, sometimes rapidly changing objectives, both animals and machines must leverage information obtained from past experience. This is a challenging task, as processing and storing all relevant information is computationally infeasible. How can an intelligent agent address this problem? We hypothesize that one route may lie in the dual process theory of cognition, a longstanding framework in cognitive psychology first introduced by William James (James, 1890) which lies at the heart of many dichotomies in both cognitive science and machine learning. Examples include goal-directed versus habitual behavior (Graybiel, 2008), model-based versus model-free reinforcement learning (Daw et al., 2011; Sutton and Barto, 2018), and "System 1" versus "System 2" thinking (Kahneman, 2011).