cs.AIApr 16, 2025

Towards LLM Agents for Earth Observation

Authors: Chia Hsiang Kao, Wenting Zhao, Cheryl Lam, Aarush Umap, Shreelekha Revankar, Samuel Speas, Snehal Bhagat, Rajeev Datta, +5 more

Organizations: Cornell University · Columbia University

Abstract

Earth Observation (EO) provides critical planetary data for environmental monitoring, disaster management, climate science, and other scientific domains. In this work we ask: Are AI systems ready for reliable Earth Observation? To answer this, we introduce UnivEARTH, a coding benchmark of 408 yes/no questions from NASA Earth Observatory articles across 7 various topics and over 15 satellite instruments and sources. Using Google Earth Engine API as a tool in a zero-shot setup, LLM agents achieve an accuracy of 40.0% where the code fails to run over 44% of the time. To better understand LLM agent behavior, we also analyze the impact of using the JavaScript API versus Python and the effect of providing documentation. Furthermore, we find that using a Reflexion framework significantly reduces errors: Claude-4.5-Sonnet, Gemini-2.5-Pro, and GPT-5 accuracies rise to around 60%. However, these results remain only marginally above random chance. Taken together, our findings identify significant challenges to be solved before AI agents can automate earth observation, and suggest paths forward.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Earth-Agent-Pro: Towards Real-World Full-Chain Earth Observation with Agents

    Sep 14, 2026Zhutao Lv, Chenhao Dang, Yi Feng +5Trustworthy Earth Observation DecisionsAgent2Agent

  2. EO-Gym: A Multimodal, Interactive Environment for Earth Observation Agents

    May 2, 2026Sai Ma, Zhuang Li, Sichao Li +4Earth ObservationGeospatial Reasoning

  3. EO-Agents: A Three-Agent LLM Pipeline for Earth Observation Hypothesis Generation

    Jul 2, 2026Mahyar Ghazanfari, Amin Tabrizian, Armin Mehrabian +1Hypothesis-Driven Model ExpansionEarth Observation