MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis
Authors: Zhengyang Xu, Han Li, Jingsong Liu, Linrui Xie, Xun Ma, Xin You, Shihui Zu, Ayako Ito, Xinyu Hao, Hongming Xu, Shaohua Kevin Zhou, Nassir Navab, Peter J. Schüffler
Organizations: Institute of Pathology, Technical University of Munich, Germany · Munich Center for Machine Learning (MCML), Munich, Germany · Computer Aided Medical Procedures (CAMP), TU Munich, Munich, Germany · Northwest University of China · Institute of Medical Robotics, Shanghai Jiao Tong University · Dalian University of Technology · Department of Human Pathology, Juntendo University Graduate School of Medicine · Cancer Hospital of Dalian University of Technology, Shenyang · University of Science and Technology of China · Munich Data Science Institute (MDSI), Munich, Germany
Recent AI navigation approaches aim to improve Whole-Slide Image (WSI) diagnosis by modeling spatial exploration and selecting diagnostically relevant regions, yet most operate at a single fixed magnification or rely on predefined magnification traversal. In clinical practice, pathologists examine slides across multiple magnifications and selectively inspect only necessary scales, dynamically integrating global and cellular evidence in a sequential manner. This mismatch prevents existing methods from modeling cross-magnification interactions and adaptive magnification selection inherent to real diagnostic workflows. To these, we propose a clinically consistent Multi-Magnification WSI Navigation Agent (MMNavAgent) that explicitly models multi magnification interaction and adaptive magnification selection. Specifically, we introduce a Cross-Magnification navigation Tool (CMT) that aggregates contextual information from adjacent magnifications to enhance discriminative representations along the navigation path. We further introduce a Magnification Selection Tool (MST) that leverages memory-driven reasoning within the agent framework to enable interactive and adaptive magnification selection, mimicking the sequential decision process of pathologists. Extensive experiments on a public dataset demonstrate improved diagnostic performance, with 1.45% gain of AUC and 2.93% gain of BACC over a non-agent baseline. Code will be public upon acceptance.
Figures & tables
Figure 1: Top: Prior navigation methods typically use a fixed magnification, yielding isolated single-scale cues. Bottom: MMNavAgent explicitly models multi-magnification interaction and adaptive magnification selection via a closed MST-CMT loop: MST selects the next action, CMT extracts high-attention regions, and the loop repeats until Stop outputs the final multi-magnification regions.
Figure 2: MMNavAgent starts from thumbnail (step 0). At each step t , MST uses the accumulated memory to select the next action and invokes CMT to extract important regions at the chosen magnification, which are stored in memory. The loop ends (Final step) when MST selects Stop, outputting navigation results.
Figure 3: Qualitative comparison of our predictions across five magnifications with eye-tracking annotations and two pathologists’ region annotations(EU and Asia).
Figure 4
Component
Patch Budget
Sampling
MAB
CMB-L
CMB-H
20%
40%
60%
80%
100%
Random
90.83% (±0.74%)
92.24% (±0.73%)
92.45% (±0.66%)
92.91% (±0.74%)
92.88% (±1.84%)
Topk
91.90% (±1.50%)
92.83% (±1.52%)
92.47% (±0.38%)
92.56% (±0.74%)
92.88% (±1.84%)
Topk
✓
91.74% (±0.37%)
92.65% (±0.94%)
92.78% (±0.42%)
92.78% (±0.69%)
92.88% (±1.84%)
Topk
✓
✓
93.23% (±0.82%)
92.70% (±0.45%)
92.91% (±0.50%)
93.34% (±0.78%)
92.88% (±1.84%)
Topk
✓
✓
93.02% (±0.38%)
92.50% (±0.91%)
92.92% (±1.69%)
92.62% (±0.69%)
92.88% (±1.84%)
Table 3: Ablation study of CMT for slide classification (AUC of 5-fold).
The diagnostic capability of WSI agents relies on effective slide navigation to identify diagnostically relevant regions and efficiently integrate evidence across the slide. While in clinical practice, pathologists dynamically examine slides across multiple scales, integrating global and cellular evidence in a sequential manner, existing AI navigation approaches mostly operate at a single fixed magnification or rely on predefined magnification traversal. This mismatch prevents existing methods from modeling cross-magnification interactions and adaptive magnification selection inherent to real diagnostic workflows. We propose PathPilot, a clinically consistent multi-magnification WSI navigation agent that explicitly models cross-magnification localization and evidence-adaptive exploration. Specifically, we introduce a CrossMagLoc that learns magnification-specific diagnostic localization from pathologist viewing behavior and integrates information from adjacent magnifications to identify the diagnostically most relevant region within the current ROI, thereby providing a diagnostically informed starting point for subsequent question-conditioned exploration. We further introduce an EviRegionSearch that starts question-conditioned exploration from this region, progressively accumulating question-relevant evidence and adaptively determining the next navigation action according to the remaining evidence requirement. Their iterative interaction enables PathPilot to sequentially explore across ROIs and magnifications until sufficient evidence is acquired. Extensive QA evaluations across five cohorts demonstrate consistent superiority over competing SOTA methods on inter/external cohorts, respectively, validating question-conditioned evidence acquisition across regions and magnifications that mirrors the sequential, knowledge-driven navigation of pathologists.
Zhengyang Xu, Han Li, Jingsong Liu +5
Institute of Pathology, Technical University of Munich, Germany · Munich Center for Machine Learning, Munich, Germany · Chair of Computer Aided Medical Procedures, Technical University of Munich, Germany +4
Whole-slide image visual question answering (WSI-VQA) frames pathology as an extreme-context search problem: to answer a free-form clinical query, a system must first navigate a gigapixel slide under a strict inspection budget to locate sparse, high-resolution evidence. Existing approaches largely fall into two paradigms: i) supervised pathology multimodal large language models (MLLMs) and agents can absorb localization and reasoning into learned modules, but they often couple navigation to task-specific supervision and retraining, limiting their practicality; ii) training-free pathology agents avoid this cost by keeping core models frozen, but often follow a question-first design, constructing the initial candidate set mainly from query-conditioned relevance. This can miss decisive morphology that is not named in the question, and force heavier inference-time scaffolding. To address this challenge, we introduce PathNavigate, a training-free pathology agent built around a scan-search-readout routine. Before question matching, PathNavigate scans the current slide at low magnification with a shared online memory module over frozen pathology features, producing a slide-specific surprise field that marks an abnormal-region pool. It then applies question-conditioned PLIP relevance only within this pool to select high-magnification search targets. Finally, it extracts local high-magnification evidence and answers with a frozen perceptor-adjudicator stack, using the same online memory as slide-level context. Experiments on WSI-VQA and SlideBench-BCNB show that the proposed scan-search-readout design improves answer accuracy and yields more interpretable evidence-selection trajectories with higher efficiency.The code is available online.
Chunze Yang, Qidong Liu, Wenjie Zhao +10
School of Comp. Science & Technology, Xi’an Jiaotong University · Tencent Jarvis Lab · University of Cambridge
Whole-slide visual reasoning requires identifying sparse diagnostic evidence in gigapixel pathology slides and integrating observations across spatial scales. Existing WSI methods either compress densely sampled patches into global representations or use pretrained vision-language models with heuristic region selection, weakening links between predictions and morphology or lacking pathology-trained observation policies. We present AdaptivePath, an active-perception framework that formulates WSI evidence acquisition as sequential decision making. The Navigator learns question-agnostic abnormality-driven navigation from pathologist-reviewed labels to select observation locations and spatial extents, avoiding costly question-specific trajectory annotations. We train this policy through alternating representation learning and proximal policy optimization, followed by fine-tuning with geometric and appearance consistency objectives to stabilize focus trajectories. During inference, the Navigator hierarchically acquires sparse observations from low to high magnification under a limited ROI budget. A Morphology Interpreter converts observations into question-conditioned evidence, while the Deliberator evaluates evidence and revises intermediate answers across magnifications. The Arbiter integrates deliberation history to produce final answers. AdaptivePath achieves state-of-the-art zero-shot performance on WSI and region pathology VQA benchmarks and reaches 80.14% accuracy for cancer subtype classification across six TCGA cohorts. In a blinded diagnostic-utility study, pathologists using AdaptivePath-selected observation sequences achieve 82.9% accuracy. These results demonstrate that learned active perception enables effective and traceable visual reasoning over gigapixel pathology slides.
Jingyun Chen, Fengchun Liu, Linghan Cai +5
College of Computer Science and Technology, Harbin Institute of Technology, Shenzhen · School of Computing and Data Science, The University of Hong Kong