Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gap