cs.CVSep 27, 2025

Streamline pathology foundation model by cross-magnification distillation

Authors: Ziyu Su, Abdul Rehman Akbar, Usama Sajjad, Anil V. Parwani, Muhammad Khalid Khan Niazi

Organizations: Department of Pathology, College of Medicine, The Ohio State University Wexner Medical Center, Columbus, OH,USA

Abstract

Foundation models (FM) have transformed computational pathology but remain computationally prohibitive for clinical deployment due to their massive parameter counts and high-magnification processing requirements. Here, we introduce XMAG, a lightweight FM developed through corss-magnification distillation that transfers knowledge from state-of-the-art 20x magnification teacher to an efficient 5x magnification student architecture. XMAG employs a compact backbone and operates entirely at 5x, requiring 11.3 times fewer patches per whole slide image (WSI) compared to existing approaches. Our Novel distillation framework incorporates dual-level knowledge transfer, aligning both global image representations and local spatial token mapping. We trained XMAG on 3.49 million images curated from publicly available datasets and evaluated performance across six clinically relevant histopathology analysis tasks spanning multiple cancer types. XMAG achieved diagnostic accuracy within 1% of substantially larger foundation models while delivering 30-fold processing acceleration, reaching 8.8 WSIs per minute processing speed. Our cross-institutional validation confirmed robust generalization. Further, we developed an end-to-end training strategy to further boost our model's performance to approach the larger FMs' performance. These results establish cross-magnification distillation as a viable approach for deploying FM capabilities in resource-constrained clinical environments, potentially enabling real-time pathology AI integration.

Explore similar work

CardsList
  1. ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts

    Jul 10, 2026Jiawen Li, Tian Guan, Huijuan Shi +5Computational PathologyUnified Multimodal Models

  2. DaX: Learning General Pathology Representations Across Scales

    Jun 5, 2026Bokai Zhao, Yiyang Zhang, Long Bai +3Pathology Foundation ModelsMedical Image Representation Learning

  3. Multi-Teacher Contrastive Distillation for Edge-Efficient Pathology Foundation Models

    Jul 6, 2026Tim Lenz, Maurice Heide, Marco Gustav +2Computational PathologyPathology Foundation Models