Multi-Agent Discovery and Resource-Aware Autonomous Exploration of Scientific Datasets
Organizations: University of Utah Salt Lake City, Utah, USA · Jet Propulsion Laboratory, Caltech Pasadena, CA, USA
Abstract
Modern scientific facilities and instruments generate datasets at scales that are difficult for individual researchers to discover, access, and explore. Although many datasets are publicly available, using them often requires familiarity with repository organization, data formats, multiresolution structures, and visualization parameters. We present WebVisus, a constrained and resource-aware multi-agent system for discovering and autonomously exploring remote, multiresolution scientific datasets. Given a natural-language research question, WebVisus identifies the user's intent and launches an autonomous exploration agent that examines slices, volumes, and timesteps while adapting data resolution and retrieval quality to available client memory and computational resources. This design supports progressive exploration without complete dataset downloads or manual configuration of low-level visualization parameters using natural languages. We report the system architecture, constrained agent protocol, resource-aware access mechanism, and case studies evaluating autonomous visual exploration and resource-aware agentic access across scientific datasets.
Figures & tables
| ID | Objective | Dataset | Agent Output | Time | Tokens | Outcome |
|---|---|---|---|---|---|---|
| T1 | Find interesting patterns in the current data | amlan-tomography-1 | Isovolume and orthogonal slices revealed an elliptical ring, prism shaped geometry, and granular alignments | 172 s | 90 k | Success |
| T2 | Find a three dimensional tomography or micro CT dataset and inspect its internal structure within 2 MB | 4D_micro_CT_sandstones | A central slice and isovolume revealed high attenuation grains within a lower density matrix and visible pore regions | 25 s | 12 k | Success |
| T3 | Identify the current dataset and produce an internal overview | Tomography | Multiple slices and an isovolume revealed concentric radial bands and granular texture | 99 s | 52 k | Success |
| T4 | Characterize pore and solid regions using slices and an isovolume | 2kbit1 | Multiple isovalue bands and orthogonal slices revealed pore regions within a connected solid matrix | 153 s | 88 k | Success |
| T5 | Find a time varying atmospheric volume and inspect its spatial and temporal structure within 2 MB | NASA DYAMOND Data | Four temporal samples with slices and an isovolume revealed evolving convective and frontal structures | 89 s | 51 k | Success |
AI Agents for Scientific Discovery
AI agents for scientific discovery use language models, tools, and experiments to generate, test, and refine scientific knowledge.
See all 287 papers