Understanding Synergistic Interactions among Pathology Foundation Models via Adaptive Fusion
Organizations: School of Computer Science and Engineering, South China University of Technology, China · School of Computing and Mathematical Sciences, University of Leicester, UK · Leicester Cancer Research Centre, University of Leicester, UK · Department of Engineering Science, University of Oxford, UK · St Catherine’s CollegeUn, University of Oxford, UK · A*STAR, Singapore · Nuffield Department of Medicine, University of Oxford, UK
Abstract
Pathology foundation models (PFMs) provide strong tile-level representations via self-supervised pre-training on large-scale pathology images. Yet, PFMs are developed under diverse and often opaque data, architecture, and objective choices, inducing latent representational biases that limit robustness and obscure what each model specialises in. We present AdaFusion, a lightweight adaptive fusion framework that integrates complementary signals from multiple frozen PFMs through (1) low-dimensional feature compression and (2) a sample-conditioned gating module that reweights model-wise (and optionally channel-wise) contributions. Beyond improving predictive accuracy, AdaFusion provides contribution-driven interpretation that offers evidence consistent with model-specific preferences and synergistic interactions across tissue phenotypes. We evaluate AdaFusion on three public benchmarks spanning treatment response prediction, prostate cancer grading, and spatial gene expression inference. AdaFusion consistently outperforms individual PFMs and other fusion baselines, while providing interpretable tissue visualisation which aligns model preferences with morphological patterns. Code is available at: https://github.com/xyx-98/PathoOracle.