Skip to content

Quest2GM/SplatSearch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

SplatSearch: SplatSearch: Instance Image Goal Navigation for Mobile Robots using 3D Gaussian Splatting and Diffusion Models

Siddarth Narasimhan · Matthew Lisondra · Haitong Wang · Goldie Nejat

University of Toronto

1117_2.mp4

The Instance Image Goal Navigation (IIN) problem requires mobile robots deployed in unknown environments to search for specific objects or people of interest using only a single reference goal image of the target. This problem can be especially challenging when: 1) the reference image is captured from an arbitrary viewpoint, and 2) the robot must operate with sparse-view scene reconstructions. In this paper, we address the IIN problem, by introducing SplatSearch, a novel architecture that leverages sparse-view 3D Gaussian Splatting (3DGS) reconstructions. SplatSearch renders multiple viewpoints around candidate objects using a sparse online 3DGS map, and uses a multi-view diffusion model to complete missing regions of the rendered images, enabling robust feature matching against the goal image. A novel frontier exploration policy is introduced which uses visual context from the synthesized viewpoints with semantic context from the goal image to evaluate frontier locations, allowing the robot to prioritize frontiers that are semantically and visually relevant to the goal image.

💡 News

  • [17 Nov 2025] Released SplatSearch on arxiv.
  • [8 Nov 2025] Submitted SplatSearch to Robotics and Automation Letters (RA-L).

🛠️ Code

We plan to release our code upon acceptance to RA-L. Stay tuned!

About

Instance Image Goal Navigation using 3D Gaussian Splatting and Diffusion Models

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published