cs.CVAug 14, 2026

PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretraining

Authors: Azim Dehghani Amirabad, Junchao Zhu, Pushpak Pati, Walid Abdelmoula, Tommaso Mansi, Rui Liao

Organizations: Johnson & Johnson Innovative Medicine.

Abstract

Spatial transcriptomics (ST) links tissue morphology with molecular programs, motivating multimodal pretraining methods that align histology images with gene expression. However, existing approaches suffer from two key limitations: spatially informative gene selection is often dominated by ubiquitous housekeeping genes, leading to weakly discriminative representations, and independent spot-patch alignment fails to capture spatial dependencies that are critical for tissue organization. To address these challenges, we introduce PaSTel, a hierarchical multimodal pretraining framework that integrates biological priors at three levels. At the spot level, TF-IDF reweighting is used to identify spatially informative genes; at the functional level, curated KEGG pathways serve as anchors for encoding global biological semantics; and at the regional level, spatial clustering aggregates neighboring spots to model meso-scale tissue structure. Across multiple downstream tasks, PaSTel consistently outperforms existing vision and vision-omics encoders, demonstrating that incorporating multiscale biological priors yields more informative and transferable representations for spatial transcriptomics.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Spatial Transcriptomics as Images for Large-Scale Pretraining

    Mar 13, 2026Yishun Zhu, Jiaxin Qi, Jian Wang +2Spatial Transcriptomics

  2. Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics

    Sep 14, 2026Daniela Vega, Paula Cárdenas, Hannah Ceballos +2Contrastive LearningSpatial Transcriptomics

  3. HiST: A Hierarchical Sparse Transformer for Cross-Modal Spatial Transcriptomics Modeling

    Jun 12, 2026Weiyi Wu, Xinwen Xu, Xingjian Diao +4Computational PathologySpatial Transcriptomics