Review for NeurIPS paper: RL Unplugged: A Collection of Benchmarks for Offline Reinforcement Learning

This paper presents a benchmark suite for offline RL, along with baseline results on this suite. There is a clear need for such a benchmark suite and all reviewers agree that this submission is a good first step towards fulfilling this need. Only R3 considers that it is not ready yet for acceptance, due to lacking more realistic benchmarks (i.e. Although I agree that this is a valid concern (and I encourage the authors to follow R3's advice and look up potential simulators that may fill up this gap), I also agree with other reviewers that the current state of the proposed benchmark should already be very useful to the research community. As a result, I recommend to accept this paper.