NavG: Risk-Aware Navigation in Crowded Environments Based on Reinforcement Learning with Guidance Points
Zhang, Qianyi, Luo, Wentao, Liu, Boyi, Zhang, Ziyang, Wang, Yaoyuan, Liu, Jingtai
–arXiv.org Artificial Intelligence
-- Motion planning in navigation systems is highly susceptible to upstream perceptual errors, particularly in human detection and tracking. T o mitigate this issue, the concept of guidance points--a novel directional cue within a reinforcement learning-based framework--is introduced. A structured method for identifying guidance points is developed, consisting of obstacle boundary extraction, potential guidance point detection, and redundancy elimination. T o integrate guidance points into the navigation pipeline, a perception-to-planning mapping strategy is proposed, unifying guidance points with other perceptual inputs and enabling the RL agent to effectively leverage the complementary relationships among raw laser data, human detection and tracking, and guidance points. Qualitative and quantitative simulations demonstrate that the proposed approach achieves the highest success rate and near-optimal travel times, greatly improving both safety and efficiency. Furthermore, real-world experiments in dynamic corridors and lobbies validate the robot's ability to confidently navigate around obstacles and robustly avoid pedestrians. With the continuous advancement of robotic technologies, a widely accepted navigation framework has emerged, encompassing perception, planning, control, and localization [1], [2]. As a downstream component, the planning module processes outputs from the perception module, such as segmented objects and detected pedestrians. In particular, inaccuracies in human detection and tracking--including misestimating a pedestrian's velocity, failing to detect a pedestrian, or misclassifying a non-pedestrian as a pedestrian, as illustrated in Fig.1--can significantly compromise navigation safety and efficiency.
arXiv.org Artificial Intelligence
Mar-3-2025