Reviews: Search on the Replay Buffer: Bridging Planning and Reinforcement Learning

Compact search spaces would confer computational benefits if nothing else. Overall, studying how compact representations of the state might might compare when used inside graph search seems like a nice way to evaluate just how much utility is added by the distributional RL component of the overall approach.