scBIG++: Learning Across Genes and Cells to Predict Single-Cell Perturbation Responses
Authors: Jiafa Ruan, Zican Qiao, Zongxin Yang, Ruijie Quan, Yi Yang
Organizations: Institute of Fundamental and Transdisciplinary Research, the College of Artificial Intelligence, and the State Key Laboratory of Brain-Machine Intelligence, Zhejiang University, Hangzhou, China · College of Artificial Intelligence, Zhejiang University, Hangzhou, China
Predicting single-cell transcriptional responses to genetic and chemical interventions supports gene-function discovery and regulatory analysis. Existing studies often focus only on highly variable genes, restricting the expression changes available for downstream analysis. Cells exposed to the same intervention can also show heterogeneous expression responses, with coordinated gene programs active to different degrees. We propose scBIG++, a full-gene perturbation prediction framework that models this heterogeneity by connecting expression-adaptive gene modules with population-conditioned generation. To preserve shared gene structure while accommodating cellular variation, Gene-Relation Clustering organizes genes into common windows, within which Dynamic SoftSub learns expression-dependent submodule memberships. This shared organization enables Set-GCAE to exchange information about corresponding gene groups across control cells, placing individual representations in their source-population context. The cell representations initialize a latent flow, while their pooled summary and the perturbation representation condition response generation. Generated states are decoded into expression profiles covering all assayed protein-coding genes retained after preprocessing, supporting comprehensive analysis of perturbation-induced expression changes. Experiments across six genetic and chemical settings spanning 6,539--19,451 genes demonstrate competitive perturbation-effect recovery and full-gene expression reconstruction under unseen targets and combinations, cross-cell-line transfer, and held-out compounds. Our implementation is available at https://github.com/ttruan2426-dot/scBIG.
Figures & tables
Fig. 1: Overview of the scBIG++ extension and representative full-gene results. (a) The common reduced-gene setup, conference scBIG, and scBIG++ are compared in gene-space coverage, gene-program organization, and prediction unit. scBIG++ retains shared windows while adding Dynamic SoftSub, full-gene encoding and reconstruction, and population-conditioned set-to-set prediction. (b) Radial comparisons of selected full-gene metrics on Norman and Replogle settings for CellFlow, scBIG, and scBIG++. Arrows indicate whether higher or lower values are preferred.
Fig. 2: Overview of scBIG++ . GRC organizes genes into shared windows, and Dynamic SoftSub refines their representations using expression-dependent memberships. Set-GCAE exchanges information across corresponding windows in control cells. The resulting cell latents and population summary condition a flow that generates perturbed states for full-gene decoding. The lower-right panel shows the training stages.
Setting
G
Generalization target
Perturbation split (train/val/test)
Norman additive [ 8 ]
19,451
Unseen CRISPRa combinations
166 / 32 / 32 perturbations
Norman holdout (single) [ 8 ]
19,451
Unseen perturbation genes
Seen-gene train / 21-gene val / 21 unseen singles
Norman holdout (double) [ 8 ]
19,451
Unseen gene pairs
Same train/val as above / 5 unseen doubles
Replogle holdout (RPE1) [ 2 ]
8,523
Unseen CRISPRi targets
1,037 / 115 / 384 conditions
Cross-cell-line transfer [ 2 , 70 ]
6,539
Unseen cellular context
HepG2/Jurkat/RPE1 train/val / 2,053 K562 test
ComboSciPlex drug [ 4 ]
16,804
Unseen drugs and combinations
Seen-drug train/val / 5 held-out test conditions
TABLE I: Main-text evaluation settings, gene universes, and perturbation splits.
TABLE III: Full-gene quantitative results on Norman holdout perturbations.
TABLE IV: Full-gene quantitative results on Replogle RPE1 holdout perturbations.
TABLE V: Full-gene quantitative results on Replogle cross-cell-line transfer (K562 test).
Setting
ρΔ↑
ρΔD↑
ACCΔD↑
MSE ↓
w/o SCA
0.8409
0.7970
0.9563
0.001643
w/o s0
0.8321
0.7964
0.9563
0.001684
w/o SCA and s0
0.8344
0.7985
0.9531
0.001707
w/o SoftSub
0.8157
0.7749
0.9766
0.001940
q-shuffled SoftSub
0.8271
0.7953
0.9641
0.001743
scBIG++
0.8521
0.8045
0.9672
0.0015
TABLE VI: Component and population analyses on Norman additive. (a,b) Component ablations and set-size sensitivity under the final objective; gray marks the default configuration. (c) Functional-coherence gains over matched random partitions ( ×10−3 ). (d) Excess Jensen–Shannon divergence over resampling noise ( ×10−4 ). Brackets denote bootstrap 95% confidence intervals; p uses a one-sided condition-level Wilcoxon test.
Predicting transcriptional responses to genetic perturbations is fundamental to functional genomics and therapeutic discovery. Recent deep learning models have shown promise in single-cell perturbation response prediction, but they typically generate each response in isolation, without explicitly leveraging related perturbations. We introduce PT-RAG (Perturbation-aware Two-stage Retrieval-Augmented Generation), a plug-in retrieval-and-conditioning module for generative cellular perturbation response. PT-RAG augments an existing perturbation-response backbone with learned access to related perturbation contexts. The key challenge is that relevance is not fixed in this setting: functionally related genes may elicit different effects across cell types. PT-RAG addresses this with a two-stage retrieval mechanism: GenePT-based semantic retrieval first identifies K candidate perturbations, after which a differentiable Gumbel-Softmax selector adaptively selects retrieved contexts conditioned on the control cell state, the query perturbation, and each candidate perturbation. We evaluate PT-RAG on two backbones, a STATE-style generator used as a frozen random reservoir and a fully trained scGPT, across cross-cell-type and cross-perturbation generalization tasks. PT-RAG consistently improves distributional similarity and often overall predictive quality; for example, on scGPT cross-cell-type results, the 2-Wasserstein distance drops by 5.9% relative to scGPT alone. The code to reproduce our experiments is available at https://github.com/difra100/PT-RAG_NIPS.
Andrea Giuseppe Di Francesco, Andrea Rubbi, Rishabh Jain +1
Predicting cellular transcriptional responses to genetic perturbations is a central problem in single-cell biology, especially in the zero-shot setting where the perturbed gene or gene combination is unseen during training. A major difficulty is that perturbation effects are not determined by expression state alone: they depend on how the perturbed gene product influences other genes and proteins, how those downstream factors act on cis-regulatory elements, and which regulatory programs are active in the current cell state. To better capture this biological complexity, we propose CisTransCell, a cell-conditioned multi-modal framework for single-cell perturbation prediction that augments each gene with two complementary priors: a regulatory-sequence prior that captures how the gene is controlled, and a coding-sequence prior that captures what the gene product does. By integrating these priors with cellular expression state, CisTransCell models perturbation response as a cascade from gene function to regulatory control to downstream transcriptional change. Experiments on benchmark single-cell perturbation datasets show that CisTransCell achieves strong performance in zero-shot perturbation prediction.
Wei Zhang, Xun Jiang, Yuesi Xi +1
1L3S Research Center, Leibniz Universität Hannover, Germany · School of Clinical Medicine & Laboratory Medicine, Jiangsu University, China · Institute for Information Processing (tnt), Leibniz Universität Hannover, Germany.
Predicting gene expression under perturbations from single-cell data is a fundamental task for modeling cellular responses, with applications in discovering gene function and designing therapeutics. However, existing methods often struggle to generalize across datasets due to differences in experimental protocols, biological contexts, and species. We present CytoWave, a perturbation-centric pretraining framework for single-cell genetic perturbation response prediction. We leverage large-scale cross-species perturbation datasets unified via orthology and train CytoWave in a two-stage manner. In the first stage, we learn reference control cell states via masked gene expression recovery on unperturbed cells. In the second stage, we pretrain the model to predict perturbed gene expression given control states and perturbation signals, together with a contrastive objective that aligns latent representations of perturbation responses with perturbation signals. We perform strict dataset-held-out evaluation across multiple condition combinations and case studies of pathway activity changes, demonstrating consistent and effective performance of CytoWave in predicting single-cell genetic perturbation responses.
Yuwei Miao, Jingquan Yan, Hehuan Ma +4
Department of Computer Science and Engineering, University of Texas at Arlington, Arlington, TX, USA · UT Southwestern Medical Center, Dallas, TX, USA