MMS-VPR: Multimodal Street-Level Visual Place Recognition Dataset and Benchmark
Ou, Yiwei, Ren, Xiaobin, Sun, Ronggui, Gao, Guansong, Jiang, Ziyi, Zhao, Kaiqi, Manfredini, Manfredo
–arXiv.org Artificial Intelligence
Existing visual place recognition (VPR) datasets predominantly rely on vehicle-mounted imagery, lack multimodal diversity and underrepresent dense, mixed-use street-level spaces, especially in non-Western urban contexts. To address these gaps, we introduce MMS-VPR, a large-scale multimodal dataset for street-level place recognition in complex, pedestrian-only environments. The dataset comprises 78,575 annotated images and 2,512 video clips captured across 207 locations in a ~70,800 $\mathrm{m}^2$ open-air commercial district in Chengdu, China. Each image is labeled with precise GPS coordinates, timestamp, and textual metadata, and covers varied lighting conditions, viewpoints, and timeframes. MMS-VPR follows a systematic and replicable data collection protocol with minimal device requirements, lowering the barrier for scalable dataset creation. Importantly, the dataset forms an inherent spatial graph with 125 edges, 81 nodes, and 1 subgraph, enabling structure-aware place recognition. We further define two application-specific subsets -- Dataset_Edges and Dataset_Points -- to support fine-grained and graph-based evaluation tasks. Extensive benchmarks using conventional VPR models, graph neural networks, and multimodal baselines show substantial improvements when leveraging multimodal and structural cues. MMS-VPR facilitates future research at the intersection of computer vision, geospatial understanding, and multimodal reasoning. The dataset is publicly available at https://huggingface.co/datasets/Yiwei-Ou/MMS-VPR.
arXiv.org Artificial Intelligence
May-20-2025
- Country:
- Asia
- China > Sichuan Province
- Chengdu (0.24)
- South Korea > Seoul
- Seoul (0.04)
- China > Sichuan Province
- North America > United States
- Michigan (0.04)
- Oceania > New Zealand
- North Island > Auckland Region > Auckland (0.04)
- Asia
- Genre:
- Research Report
- Experimental Study (1.00)
- New Finding (0.93)
- Research Report
- Industry:
- Health & Medicine (1.00)
- Information Technology > Security & Privacy (1.00)
- Law (0.92)
- Transportation > Ground
- Road (0.67)
- Technology:
- Information Technology
- Artificial Intelligence
- Machine Learning
- Neural Networks > Deep Learning (0.93)
- Statistical Learning (1.00)
- Natural Language (1.00)
- Representation & Reasoning (1.00)
- Vision (1.00)
- Machine Learning
- Communications > Social Media (1.00)
- Data Science > Data Mining (1.00)
- Information Management (1.00)
- Security & Privacy (1.00)
- Sensing and Signal Processing > Image Processing (1.00)
- Artificial Intelligence
- Information Technology