cs.CVNov 10, 2026

Predicting Single-Cell Spatial Gene Expression from H&E using Pathology Foundation Models

Authors: Ashley P. Tsang, Evan Liu, Conrad Foo, Bob Chen, Hassaan Maan, Donny Chan, Elisa Penna, Veronica Ibarra Lopez, 

Organizations: AI for Biology & Translation, Computational Sciences Center of Excellence, Genentech · Gilbert S. Omenn Department of Computational Medicine & Bioinformatics, University of Michigan · Computational Biology & Medicine, Computational Sciences Center of Excellence, Genentech · Digital and Spatial Pathology, Translational Genomics and Proteomics, gRED, Genentech

Abstract

Predicting gene expression directly from hematoxylin and eosin (H&E) images offers a scalable and cost-effective approach to deriving spatial molecular insights from routine histology. Pathology foundation models, typically pretrained using tile-level objectives, may not adequately capture the fine-grained cellular features required for single-cell molecular prediction. In this work, we systematically evaluate and establish domain-informed and task-specific strategies for adapting pathology foundation models to single-cell spatial gene expression prediction. Using paired H&E and Xenium 5K data, our approach improves mean gene-wise Pearson correlation by 2.67x over the standard zero-shot baseline and achieves state-of-the-art performance on this task. We demonstrate strong gene-detection performance across the full gene panel (AUROC = 0.800) and importantly identify that predictive performance varies substantially across biological contexts, with our model achieving its highest Pearson correlation for spatially variable genes (r = 0.643). Our findings demonstrate that, despite the challenges of sparse single-cell measurements, H&E-derived representations can recover biologically meaningful spatial expression patterns, highlighting both the opportunities and limitations of morphology-based molecular inference at cellular resolution.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images

    Sep 29, 2026Zijun Gao, Chunbin Gu, Jinxi Xiang +2Spatial TranscriptomicsSpatial Attention

  2. VOICE: A Vision-Omics Foundation Model Integrating Direct and Retrieval-Based Prediction of In-situ Single-Cell Gene Expression

    Aug 8, 2026Xin Luo, Yicheng Tao, Haoxuan Zeng +6Computational PathologySpatial Transcriptomics

  3. HistoGPA: A Context-Conditioned Gene-Prior Attention Framework for Histology-Based Spatial Gene Expression Prediction

    Jul 27, 2026Ziang Liu, Xinhai Chen, Yigui Feng +3Computational PathologySpatial Transcriptomics