EX2: Exploration with Exemplar Models for Deep Reinforcement Learning

Justin Fu, John Co-Reyes, Sergey Levine

Neural Information Processing Systems 

The intuition is that, if a state is easy to distinguish from other states, it is likely to be novel.