cs.CVFeb 15, 2026

MarsRetrieval: Benchmarking Vision-Language Models for Planetary-Scale Geospatial Retrieval on Mars

Authors: Shuoyuan Wang, Yiran Wang, Hongxin Wei

Organizations: Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen, China · Department of Earth and Space Sciences, Southern University of Science and Technology, Shenzhen, China

Abstract

Data-driven approaches like deep learning are rapidly advancing planetary science, particularly in Mars exploration. Despite recent progress, most existing benchmarks remain confined to closed-set supervised visual tasks and do not support text-guided retrieval for geospatial discovery. We introduce MarsRetrieval, a retrieval benchmark for evaluating vision-language models for Martian geospatial discovery. MarsRetrieval includes three tasks: (1) paired image-text retrieval, (2) landform retrieval, and (3) global geo-localization, covering multiple spatial scales and diverse geomorphic origins. We propose a unified retrieval-centric protocol to benchmark multimodal embedding architectures, including contrastive dual-tower encoders and generative vision-language models. Our evaluation shows MarsRetrieval is challenging: even strong foundation models often fail to capture domain-specific geomorphic distinctions. We further show that domain-specific fine-tuning is critical for generalizable geospatial discovery in planetary settings. Our code is available at https://github.com/ml-stat-Sustech/MarsRetrieval

Figures & tables

Appendix figures & tables22 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. MarsRecon: Self-Supervised and Multimodal Surface Representations for Mars

    Sep 17, 2026Akshay Naik, Marius F. R. Juston, Jay MahajanGeospatial Representation LearningSelf-Supervised Visual Representation Learning

  2. LLaVA-LE: Large Language-and-Vision Assistant for Lunar Exploration

    Mar 25, 2026Gokce Inal, Pouyan Navard, Alper YilmazVision-Language ModelsLarge Vision-Language Models

  3. MARTIAN: A Rendering Framework for Aerial Mars Imagery from HiRISE Orbital Data

    May 28, 2026Dario Pisanti, Georgios GeorgakisVisual NavigationAerial Robotics