MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulation
Li, Chengshu, Xu, Mengdi, Bahety, Arpit, Yin, Hang, Jiang, Yunfan, Huang, Huang, Wong, Josiah, Garlanka, Sujay, Gokmen, Cem, Zhang, Ruohan, Liu, Weiyu, Wu, Jiajun, Martín-Martín, Roberto, Fei-Fei, Li
–arXiv.org Artificial Intelligence
Imitation learning from large-scale, diverse human demonstrations has proven effective for training robots, but collecting such data is costly and time-consuming. This challenge is amplified for multi-step bimanual mobile manipulation, where humans must teleoperate both a mobile base and two high-degree-of-freedom arms. Prior automated data generation frameworks have addressed static bimanual manipulation by augmenting a few human demonstrations in simulation, but they fall short for mobile settings due to two key challenges: (1) determining base placement to ensure reachability, and (2) positioning the camera to provide sufficient visibility for visuomotor policies. To address these issues, we introduce MoMaGen, which formulates data generation as a constrained optimization problem that enforces hard constraints (e.g., reachability) while balancing soft constraints (e.g., visibility during navigation). This formulation generalizes prior approaches and provides a principled foundation for future methods. We evaluate MoMaGen on four multi-step bimanual mobile manipulation tasks and show that it generates significantly more diverse datasets than existing methods. Leveraging this diversity, MoMaGen can train successful imitation learning policies from a single source demonstration, and these policies can be fine-tuned with as few as 40 real-world demonstrations to achieve deployment on physical robotic hardware. More details are available at our project page: momagen.github.io.
arXiv.org Artificial Intelligence
Oct-22-2025
- Country:
- North America > United States
- Texas > Travis County > Austin (0.04)
- Oceania > New Zealand
- North Island > Auckland Region > Auckland (0.04)
- North America > United States
- Genre:
- Research Report (1.00)
- Technology: