cs.CVMar 17, 2026

Segmentation-before-Staining Improves Structural Fidelity in Virtual IHC-to-Multiplex IF Translation

Authors: Junhyeok Lee, Han Jang, Heeseong Eum, Joon Jang, Kyu Sung Choi

Organizations: Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine, Seoul, Republic of Korea · Interdisciplinary Program in Bioengineering, Seoul National University, Seoul, Republic of Korea · Department of Biomedical Sciences, Seoul National University, Seoul, Republic of Korea · Department of Radiology, Seoul National University Hospital, Seoul, Republic of Korea · 

Abstract

Multiplex immunofluorescence (mIF) enables simultaneous single-cell quantification of multiple biomarkers within intact tissue architecture, yet its high reagent cost, multi-round staining protocols, and need for specialized imaging platforms limit routine clinical adoption. Virtual staining can synthesize mIF channels from widely available brightfield immunohistochemistry (IHC), but current translators optimize pixel-level fidelity without explicitly constraining nuclear morphology. In pathology, this gap is clinically consequential: subtle distortions in nuclei count, shape, or spatial arrangement propagate directly to quantification endpoints such as the Ki67 proliferation index, where errors of a few percent can shift treatment-relevant risk categories. This work introduces a supervision-free, architecture-agnostic conditioning strategy that injects a continuous cell probability map from a pretrained nuclei segmentation foundation model as an explicit input prior, together with a variance-preserving regularization term that matches local intensity statistics to maintain cell-level heterogeneity in synthesized fluorescence channels. The soft prior retains gradient-level boundary information lost by binary thresholding, providing a richer conditioning signal without task-specific tuning. Controlled experiments across Pix2Pix with U-Net and ResNet generators, deterministic regression U-Net, and conditional diffusion on two independent datasets demonstrate consistent improvements in nuclei count fidelity and perceptual quality, as the sole modifications. Code will be made publicly available upon acceptance.

Figures & tables

Explore similar work

CardsList
  1. UNIStainNet: Foundation-Model-Guided Virtual Staining of H&E to IHC

    Mar 13, 2026Jillur Rahman Saurav, Thuong Le Hoai Pham, Pritam Mukherjee +3Virtual StainingComputational Pathology

  2. Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints

    Sep 1, 2026Baoshun Wang, Weiping Lin, Linwu Wang +3Computational PathologyImage-to-Image Translation

  3. VitaminP: cross-modal learning enables whole-cell segmentation from routine histology

    Apr 26, 2026Yasin Shokrollahi, Karina B. Pinao Gonzales, Elizve N. Barrientos Toro +5Cross-Modal LearningComputational Pathology