SplatSearch: Instance Image Goal Navigation for Mobile Robots using 3D Gaussian Splatting and Diffusion Models

Narasimhan, Siddarth, Lisondra, Matthew, Wang, Haitong, Nejat, Goldie

arXiv.org Artificial Intelligence 

The Instance Image Goal Navigation (IIN) problem requires mobile robots deployed i n unknown environments to search for specific objects or people of interest using only a single reference goal image of the target . This problem can be especially challenging when: 1) the reference image is captured from an arbitrary viewpoint, and 2) the robot must operate with sparse - view scene reconstructions. I n this paper, we address the IIN problem, by introduc ing SplatSearch, a novel architecture that leverages sparse - view 3D Gaussian Splatting (3DGS) reconstructions. SplatSearch renders multiple viewpoints around candidate objects using a sparse online 3DGS map, and uses a multi - view diffusion model to complete missing regions of the rendered image s, enabling robust feature matching against the goal image . A novel frontier exploration policy is introduced which uses visual context from the synthesized viewpoints with semantic context from the goal image to evaluate frontier locations, allowing the robot to prioritize frontiers that are semantically and visually relevant to the goal image . An ablation study confirms the design choices of SplatSearch.

Duplicate Docs Excel Report

Title
None found

Similar Docs  Excel Report  more

TitleSimilaritySource
None found