Review for NeurIPS paper: Task-agnostic Exploration in Reinforcement Learning

Neural Information Processing Systems 

There are quite a few existing exploration solutions to visit all the states often. But these works were not compared or discussed. Concretely I gave 3 examples. While reading the authors rebuttal I understand why two of them are less relevant to their specific setup. There are, however, many more works which I did not provide in my review and are still relevant.