Embodied Navigation Foundation Model
Zhang, Jiazhao, Li, Anqi, Qi, Yunpeng, Li, Minghan, Liu, Jiahang, Wang, Shaoan, Liu, Haoran, Zhou, Gengze, Wu, Yuze, Li, Xingxing, Fan, Yuxin, Li, Wenjun, Chen, Zhibo, Gao, Fei, Wu, Qi, Zhang, Zhizheng, Wang, He
–arXiv.org Artificial Intelligence
Navigation is a fundamental capability in embodied AI, representing the intelligence required to perceive and interact within physical environments. To achieve such intelligence, recent advanced works leverage Vision-Language Models (VLMs), which demonstrate strong generalizability and possess a well-suited formulation for navigation. However, these approaches remain largely confined to narrow task settings and embodiment-specific architectures. In this work, we introduce a cross-embodiment and cross-task Navigation Foundation Model (Nav-FoM), trained on eight million navigation samples that encompass quadrupeds, drones, wheeled robots, and vehicles, and spanning diverse tasks such as vision-and-language navigation, object searching, target tracking, and autonomous driving. NavFoM employs a unified architecture that processes multimodal navigation inputs from varying camera configurations and navigation horizons. To accommodate diverse camera setups and temporal horizons, NavFoM incorporates identifier tokens that embed camera view information of embodiments and the temporal context of tasks. Furthermore, to meet the demands of real-world deployment, NavFoM controls all observation tokens using a dynamically adjusted sampling strategy under a limited token length budget. Extensive evaluations on seven public benchmarks demonstrate that our model achieves state-of-the-art or highly competitive performance across different navigation tasks and embodiments without requiring task-specific fine-tuning. Additional real-world experiments further confirm the strong generalizability and practical applicability of our approach. Figure 1: We provide an illustration of architecture (left) alongside real-world experiment results (right). The results include cross-task and cross-embodiment performence of our method. See Sec. 4 for more detials. For both embodied agents and humans, navigation serves as a foundational capability that enables them to move intelligently within physical environments to accomplish specified tasks (Shah et al., 2023a; Bar et al., 2025; Zhang et al., 2024b). Achieving robust navigation requires a deep understanding of environmental context and task instructions, typically presented through visual and linguistic observations, which are reminiscent of Visual Language Models (VLMs).
arXiv.org Artificial Intelligence
Sep-18-2025
- Genre:
- Research Report > New Finding (0.93)
- Industry:
- Technology:
- Information Technology > Artificial Intelligence
- Vision (1.00)
- Robots > Autonomous Vehicles (1.00)
- Machine Learning (1.00)
- Natural Language > Large Language Model (0.95)
- Information Technology > Artificial Intelligence