Unraveling the Effects of Synthetic Data on End-to-End Autonomous Driving
Ge, Junhao, Liu, Zuhong, Fan, Longteng, Jiang, Yifan, Su, Jiaqi, Li, Yiming, Zhang, Zhejun, Chen, Siheng
–arXiv.org Artificial Intelligence
End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity synthetic data essential for enhancing data diversity and model robustness. Existing driving simulators for synthetic data generation have significant limitations: game-engine-based simulators struggle to produce realistic sensor data, while NeRF-based and diffusion-based methods face efficiency challenges. Additionally, recent simulators designed for closed-loop evaluation provide limited interaction with other vehicles, failing to simulate complex real-world traffic dynamics. To address these issues, we introduce SceneCrafter, a realistic, interactive, and efficient AD simulator based on 3D Gaussian Splatting (3DGS). SceneCrafter not only efficiently generates realistic driving logs across diverse traffic scenarios but also enables robust closed-loop evaluation of end-to-end models. Experimental results demonstrate that SceneCrafter serves as both a reliable evaluation platform and a efficient data generator that significantly improves end-to-end model generalization.
arXiv.org Artificial Intelligence
Mar-23-2025
- Country:
- North America > United States (0.14)
- Genre:
- Research Report > New Finding (0.66)
- Industry:
- Automobiles & Trucks (0.73)
- Information Technology > Robotics & Automation (0.63)
- Leisure & Entertainment > Games
- Computer Games (0.48)
- Transportation > Ground
- Road (0.63)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning (1.00)
- Representation & Reasoning > Agents (0.67)
- Robots > Autonomous Vehicles (0.73)
- Vision (1.00)
- Information Technology > Artificial Intelligence