Why Generalization in RL is Difficult: Epistemic POMDPs and Implicit Partial Observability

Neural Information Processing Systems 

Generalization is a central challenge in machine learning.