cs.CVMar 24, 2026

Cross-Slice Knowledge Transfer via Masked Multi-Modal Heterogeneous Graph Contrastive Learning for Spatial Gene Expression Inference

Authors: Zhiceng Shi, Changmiao Wang, Jun Wan, Wenwen Min

Organizations: Yunnan University, Kunming 650500, China · Shenzhen Research Institute of Big Data, Shenzhen 518172, China · Zhongnan University of Economics and Law, Wuhan 430073, China

Abstract

While spatial transcriptomics (ST) has advanced our understanding of gene expression in tissue context, its high experimental cost limits its large-scale application. Predicting ST from pathology images is a promising, cost-effective alternative, but existing methods struggle to capture complex cross-slide spatial relationships. To address the challenge, we propose SpaHGC, a multi-modal heterogeneous graph-based model that captures both intra-slice and inter-slice spot-spot relationships from histology images. It integrates local spatial context within the target slide and cross-slide similarities computed from image embeddings extracted by a pathology foundation model. These embeddings enable inter-slice knowledge transfer, and SpaHGC further incorporates Masked Graph Contrastive Learning to enhance feature representation and transfer spatial gene expression knowledge from reference to target slides, enabling it to model complex spatial dependencies and significantly improve prediction accuracy. We conducted comprehensive benchmarking on seven matched histology-ST datasets from different platforms, tissues, and cancer subtypes. The results demonstrate that SpaHGC significantly outperforms the existing nine state-of-the-art methods across all evaluation metrics. Additionally, the predictions are significantly enriched in multiple cancer-related pathways, thereby highlighting its strong biological relevance and application potential.

Figures & tables

Explore similar work

CardsList
  1. CHRep: Cross-modal Histology Representation and Post-hoc Calibration for Spatial Gene Expression Prediction

    Apr 23, 2026Changfan Wang, Xinran Wang, Donghai Liu +4Spatial TranscriptomicsPost-Hoc Calibration

  2. Contrastive and Adaptive Multi-modal Masked Autoencoder for Spatial Transcriptomics

    Jun 19, 2026Joohyeok Kim, Taejin Jeong, Jinyeong Kim +1Computational PathologySpatial Transcriptomics

  3. Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics

    Sep 14, 2026Daniela Vega, Paula Cárdenas, Hannah Ceballos +2Contrastive LearningSpatial Transcriptomics