Organizations: University of Science and Technology of China · Shanghai Artificial Intelligence Laboratory · MIRACLE Lab · The Hong Kong University of Science and Technology (Guangzhou) · Shanghai Jiaotong University · Ant Group · Nantong University · Zhejiang University · Tianjin University · Durham University · Jinan University · Southeast University · The University of Nottingham Ningbo China · University of Electronic Science and Technology of China · University of Leicester
Analyzing whole-slide images (WSIs) requires combining evidence across tissue regions and spatial scales. Multi-agent systems offer a promising approach to this task. However, existing systems make limited use of molecular evidence, often select visually prominent but less representative regions while overlooking global context, and struggle to reuse experience from previous cases. To address these challenges, we present PathLoop, a self-evolving multi-agent framework that integrates omics data for evidence-grounded WSI analysis. Specifically, PathLoop coordinates visual and omics interpreters across slide, patch, and pixel levels, using molecular signals to guide region selection and combining local tissue details with global slide features. A judgment agent then checks the consistency of the collected evidence against Pathology-Wiki, a knowledge base built from 48 entries across 24 organ systems, and triggers re-examination when the evidence is inconsistent. To reuse past experience, a four-level memory stores reasoning trajectories, practical tips, skills, and tools to guide future cases, forming a loop of evidence collection, review, and memory update. We evaluate PathLoop on four TCGA cohorts with biomarker prediction, survival prediction, and subtype classification. The results demonstrate the effectiveness of PathLoop across these tasks and support its use for evidence-grounded WSI analysis.
Figures & tables
Figure 1: Comparison between existing WSI analysis paradigms and PathLoop. (A) WSI-only methods rely primarily on visually salient ROIs and may miss diagnostically informative but visually inconspicuous regions. (B) Existing WSI–omics methods fuse separately encoded visual and molecular features, without using omics to guide ROI selection. (C) PathLoop leverages omics-informed planning to select task-relevant ROIs and introduces a feedback loop from prediction to planning for iterative refinement.
Figure 2: The PathLoop framework comprises four alternating phases. The Planning Agent analyzes the input and formulates a plan by drawing on historical experience. The Execution Agent performs slide-, patch-, and pixel-level processing and integrates omics data. The Judgment Agent conducts a consistency review against Pathology-Wiki. Finally, the Persist Agent builds a four-level memory from past trajectories, which is retrieved to guide reasoning in future cases.
Figure 3: Overview of Pathology-Wiki. (a) Organ coverage of the knowledge base, spanning 24 organ systems and 48 subtype codes. Codes marked with † share content with another code, resulting in 43 distinct pages. (b) Word counts for major diagnostic sections in each page, showing the completeness and depth of the curated content. (c) Cross-organ differential-diagnosis DDx links among 43 pages, highlighting 16 page pairs that reference entities from different organs. (d) IHC profiles of the linked pages, summarizing positive and negative markers that support differential diagnosis.
Method
Modality
ER (AUC)
PR (AUC)
HER2 (AUC)
Subtype (AUC)
Risk (C-index)
▼ Conventional Methods
SNN
O
0.952 ± 0.021
0.885 ± 0.035
0.725 ± 0.045
0.958 ± 0.015
0.620 ± 0.045
SNNTrans
O
0.958 ± 0.018
0.912 ± 0.028
0.765 ± 0.038
0.970 ± 0.012
0.645 ± 0.038
ABMIL
W
0.885 ± 0.032
0.755 ± 0.045
0.655 ± 0.052
0.955 ± 0.022
0.590 ± 0.052
TransMIL
W
0.901 ± 0.028
0.763 ± 0.041
0.687 ± 0.048
0.972 ± 0.015
0.615 ± 0.048
MCAT
O+W
0.975 ± 0.022
0.935 ± 0.031
0.768 ± 0.042
0.975 ± 0.018
0.665 ± 0.042
Table 1: Comparison with SOTA methods on multi-task prediction on TCGA-BRCA. AUC for ER/PR/HER2, macro AUC for Subtype, and C-index for Risk. Modality denotes the input data: O for omics, W for WSI, and O+W for both. The best and second-best results are highlighted in bold and underlined , respectively.
Method
Alignment
NLP Metrics
CLIP-cos
BLEU-1
BLEU-4
METEOR
ROUGE-L
w/ Projector
0.66
0.53
0.14
0.17
0.19
w/o Projector
0.53
0.43
0.02
0.04
0.06
Quilt-LLaVA
0.485
0.47
0.03
0.07
0.06
HistGen
0.51
0.08
0.01
0.10
0.10
MDAgents
0.46
0.01
0.00
0.05
0.06
Table 2: Ablation study of the projector module and comparative experiments on language generation performance.
Method
BLCA
LUAD
BRCA
UCEC
Mean
SNN
0.541 ± 0.016
0.539 ± 0.069
0.620 ± 0.045
0.493 ± 0.069
0.548
SNNTrans
0.646 ± 0.043
0.634 ± 0.049
0.645 ± 0.038
0.632 ± 0.032
0.639
TransMIL
0.576 ± 0.065
0.615 ± 0.034
0.615 ± 0.048
0.549 ± 0.044
0.589
E2E-CONCH
0.653 ± 0.024
0.705 ± 0.029
0.660 ± 0.014
0.614 ± 0.076
0.658
MCAT
0.645 ± 0.053
0.636 ± 0.043
0.665 ± 0.042
0.634 ± 0.018
0.645
MOTCat
0.674 ± 0.024
0.674 ± 0.036
0.685 ± 0.035
0.667 ± 0.051
0.675
Table 3: Comparison of survival risk prediction (C-index) on four TCGA cohorts. The best and second-best results are highlighted in bold and underlined , respectively.
Figure 4: Kaplan-Meier Analysis of predicted high-risk and low-risk groups. Shaded areas refer to the confidence intervals.
Figure 5: Explainability analysis through visualization on case TCGA-C8-A1HK.
Module
Setting
C-index
Planning
w/o CLS token
0.704
Execution
w/o Projector
0.676
Execution
w/o Omics
0.642
Judgment
w/o Pathology-Wiki
0.648
Persist
w/o Memory
0.703
Table 4: Ablation study of the agent modules on TCGA-BRCA. The full model achieves a C-index of 0.735.
Setting
ER
PR
HER2
Subtype
Risk
Wours
0.964
0.958
0.854
0.983
0.735
Wnoise
0.939
0.897
0.578
0.975
0.685
Wdrop
0.935
0.861
0.770
0.900
0.725
Wshuffle
0.912
0.897
0.667
0.989
0.684
Wrandom
0.898
0.764
0.797
0.893
0.686
K=8
0.577
0.745
0.523
0.659
0.563
Table 5: Ablation study of different settings on TCGA-BRCA.
LogReg C
ER
PR
HER2
Subtype
Risk
0.1
0.964
0.958
0.854
0.983
0.735
0.5
0.954
0.958
0.804
0.931
0.691
1.0
0.881
0.958
0.803
0.992
0.698
Table 6: Sensitivity analysis of logistic regression.
1Korea Advanced Institute of Science and Technology (KAIST) · Institute of Advanced Intelligence and Computing (IAIC), A*STAR · Centre for Frontier AI Research (CFAR), A*STAR