Generating drug-induced transcriptional responses requires a model to account for cellular background together with molecular identity and dose. We present scTREAT, the first diffusion framework to factorize state and drug guidance for single-cell drug-response prediction. A shared latent expression space connects baseline and response, while Guided Decomposable Attention (GD-Attn) injects a baseline representation and a dose-conditioned molecular embedding. Independent channel dropout exposes four conditioning states during training; inference combines three conditional predictions with separately specified state and drug coefficients, and dose modulates drug-guidance strength. On condition-level pseudobulk profiles derived from the Tahoe-100M single-cell atlas, scTREAT achieves the best value on 10 of 12 metrics for unseen cell line-drug combinations (UC) and 11 of 12 for unseen drugs (UD). Ablations examine condition injection, molecular representation, and guidance design. On UD, the relative gains over the second-best model reach 36.11% and 34.21% for DEG logFC-Spearman and logFC-Pearson. These results demonstrate the effectiveness of combining shared latent expression modeling with explicit state and drug conditioning for response prediction.
Figures & tables
Figure 1: Overview of scTREAT. Top: Expression is encoded in a shared autoencoder latent space; the denoising path summarizes neural noise prediction and reverse-sampling updates to z^0 , followed by decoding to x^ . Bottom: The matched-control representation zpre=E(xpre) and dose-fused drug vector z~drug from Morgan fingerprints + MLP ( Rogers & Hahn, 2010 ; Landrum et al., ) form a condition token c injected through GD-Attn ( Section 3.2 ).
Figure 2: Conditional denoising from zT . Three noise predictions from a four-state-trained denoiser are combined with separate state/drug guidance for each reverse-sampler update to zt−1 . Decoding the final z^0 gives the predicted expression.
Model
logFC-P
logFC-S
Δ -P
Δ -S
EVmedian
scTREAT
0.81
0.69
0.55
0.51
0.73
chemCPA
0.70
0.46
0.59
0.44
0.70
PRnet
0.61
0.58
0.35
0.27
0.51
STATE
0.77
0.69
0.50
0.50
0.69
scGPT
0.46
0.39
0.39
0.35
0.41
Linear
0.50
0.51
0.48
0.41
0.20
Table 1: UC results. Higher is better; bold and underline mark the best and second-best distinct values, with ties sharing formatting. Correlations and median explained variance ( EV ) are reported for all genes and the Top-200 genes by observed absolute logFC (DEG). P and S denote Pearson and Spearman correlations. Overlap@200 and Overlap@1000 denote the corresponding DEG-accuracy metrics.
Model
logFC-P
logFC-S
Δ -P
Δ -S
EVmedian
scTREAT
0.67
0.58
0.50
0.49
0.66
chemCPA
0.42
0.44
0.53
0.43
0.59
PRnet
0.59
0.48
0.33
0.25
0.42
Linear
0.43
0.49
0.46
0.40
0.18
MLP
0.40
0.36
0.43
0.34
0.32
Context
0.31
0.32
0.42
0.39
0.40
Table 2: UD results. Methods without unseen-drug support are omitted. Higher is better; bold and underline mark the best and second-best distinct values, with ties sharing formatting. Metric abbreviations and the DEG subset follow Table 1 .
Figure 3: Ablations on UC (a) and UD (b). Conditioning, GD-Attn, and separate guidance support predictive performance; molecular structure supports UD generalization; dose-dependent guidance improves selected metrics. Variants: (A) no conditioning; (B) GD-Attn replaced by Concat+MLP; (C) molecular structure replaced by Drug-ID; (D) single-channel CFG; (E) constant drug-guidance strength; (F) concatenation of condition and latent tokens before attention. Full configurations are in Appendix F .
Figure 4: Qualitative response prediction. Predicted profiles separate by cell line in UMAP space (left), while predicted and observed gene-wise logFC distributions agree for representative cell lines (right).
Figure 5: Biological context. Left: KRAS GSEA curves share a broad shape but differ in their dominant signed deviations. Right: drug representations show MoA-associated grouping with overlap between some classes.
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Figure 6: Exploratory GSEA comparison for HALLMARK_PI3K_AKT_MTOR_SIGNALING. Predicted and observed curves share broad shape features but differ in amplitude and dominant signed deviation.
Longitudinal single cell atlases now capture matched pre treatment and post treatment states from responders and non responders, presenting an opportunity to mechanistically explain why two patients on the same drug diverge. We introduce scDEFT (single cell Drug EFfect Transducer), which treats a drug as a conditioning operator on cell representations, enabling prediction and explanation. In scDEFT, feature wise linear modulation produces drug conditioned cell latents, learned under abundant per cell supervision and then frozen. Two independent heads aggregate those latents over shared transcriptional neighborhoods to predict drug induced state change and responder status. A backward stage ranks the latent dimensions by how strongly they separate responders from non responders and maps them to genes under a cell composition control. On a harmonized inflammatory bowel disease atlas of 1.16 million cells, three cohorts and two drug classes, scDEFT predicts state change at 45% of the baseline to reproducibility ceiling headroom and stratifies responders before treatment at AUROC 0.70, where standard predictors remain at chance. These predictions and the drivers behind them support target and co target nomination, patient stratification, and counterfactual prediction of unseen drug cohort effects.
Scarce data and tumor heterogeneity limit patient-level cancer treatment-response prediction. Existing approaches predict response from pretreatment molecular profiles and drug representations, without explicitly modeling the molecular changes expected under treatment. We propose PerturbRx, a treatment-conditioned representation learning framework that learns intervention-induced latent transitions and uses them as patient-drug response features. PerturbRx trains a drug- and dose-conditioned transition predictor from context-matched but cell-unpaired control and treated single-cell populations, then freezes and transfers the predictor to pretreatment patient profiles without requiring post-treatment measurements. The transition is combined with patient and drug representations to predict response. Across TCGA and patient-derived xenograft benchmarks, PerturbRx achieves the strongest aggregate predictive performance among the evaluated methods. These results support perturbation-pretrained latent transitions as useful representations for patient-level drug-response prediction.
Yoshitaka Inoue, Minoh Jeong, Alfred Hero +2
Department of Computer Science, University of Minnesota, Minneapolis, MN, USA · Computational Biology Branch, National Library of Medicine, Bethesda, MD, USA · Therapeutic Development Branch, National Library of Medicine, Bethesda, MD, USA +2
Predicting transcriptional responses to genetic perturbations is fundamental to functional genomics and therapeutic discovery. Recent deep learning models have shown promise in single-cell perturbation response prediction, but they typically generate each response in isolation, without explicitly leveraging related perturbations. We introduce PT-RAG (Perturbation-aware Two-stage Retrieval-Augmented Generation), a plug-in retrieval-and-conditioning module for generative cellular perturbation response. PT-RAG augments an existing perturbation-response backbone with learned access to related perturbation contexts. The key challenge is that relevance is not fixed in this setting: functionally related genes may elicit different effects across cell types. PT-RAG addresses this with a two-stage retrieval mechanism: GenePT-based semantic retrieval first identifies K candidate perturbations, after which a differentiable Gumbel-Softmax selector adaptively selects retrieved contexts conditioned on the control cell state, the query perturbation, and each candidate perturbation. We evaluate PT-RAG on two backbones, a STATE-style generator used as a frozen random reservoir and a fully trained scGPT, across cross-cell-type and cross-perturbation generalization tasks. PT-RAG consistently improves distributional similarity and often overall predictive quality; for example, on scGPT cross-cell-type results, the 2-Wasserstein distance drops by 5.9% relative to scGPT alone. The code to reproduce our experiments is available at https://github.com/difra100/PT-RAG_NIPS.
Andrea Giuseppe Di Francesco, Andrea Rubbi, Rishabh Jain +1