Real-Time Spatial Reasoning by Mobile Robots for Reconstruction and Navigation in Dynamic LiDAR Scenes

--Our brain has an inner global positioning system which enables us to sense and navigate 3D spaces in real time. Can mobile robots replicate such a biological feat in a dynamic environment? We introduce the first spatial reasoning framework for real-time surface reconstruction and navigation that is designed for outdoor LiDAR scanning data captured by ground mobile robots and capable of handling moving objects such as pedestrians. Our reconstruction-based approach is well aligned with the critical cellular functions performed by the border vector cells (BVCs) over all layers of the medial entorhinal cortex (MEC) for surface sensing and tracking. T o address the challenges arising from blurred boundaries resulting from sparse single-frame LiDAR points and outdated data due to object movements, we integrate real-time single-frame mesh reconstruction, via visibility reasoning, with robot navigation assistance through on-the-fly 3D free space determination. This enables continuous and incremental updates of the scene and free space across multiple frames. Key to our method is the utilization of line-of-sight (LoS) vectors from LiDAR, which enable real-time surface normal estimation, as well as robust and instantaneous per-voxel free space updates. Comprehensive experiments on both synthetic and real scenes highlight our method's superiority in speed and quality over existing real-time LiDAR processing approaches. UMANS and most animals all possess the innate ability to sense and navigate through spatial environments around them in real time. While the complete and precise mechanisms behind such capabilities are not yet fully understood, the Nobel-winning work conducted by John O'Keefe in the 1970s on place cells [1], [2] has paved the way for understanding the brain's "inner global positioning system (GPS)". Pengdi Huang, Mingyang Wang, Huan Tian, and Hui Huang are with College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China (email: alualu628628@gmail.com; Minglun Gong is with School of Computer Science, University of Guelph, Delft N1G 2W1, Canada (email: minglun@uoguelph.ca) Hao Zhang is with School of Computing Science, Simon Fraser University, Burnaby V3J 1A1, Canada (email: haoz@sfu.ca)