Bison: Cross-Dataset Learning for Unseen-Compound Perturbation Prediction
Organizations: Zhejiang University · Westlake University · Beihang University · Nanjing University
Abstract
Predicting transcriptional responses to unseen compounds is limited by fragmented chemical coverage and heterogeneous experimental platforms and gene panels. To assess molecular generalization across these settings, we build on Chem-PerturBridge to benchmark eight datasets with 16,771 compounds, withholding test compounds from every training dataset. This comparison reveals that high overall response agreement can coexist with weak prediction of drug-specific differences, despite reproducible signals across repeated measurements. To exploit complementary chemical supervision while targeting these differences, we introduce Bison: a shared gene representation connects native panels, while two discrete diffusion models compose context-dependent responses with molecular deviations learned through matched drug-contrast supervision. A single Bison model jointly trained across all eight datasets achieves the highest mean overall-response and drug-contrast Pearson correlations on the full benchmark in comparison with 11 methods trained independently per dataset. Compared with dataset-specific training of the same architecture, joint training increases mean drug-contrast correlation by 27.4%, with gains across all eight datasets and improvements in overall response prediction. These results demonstrate how matched drug contrasts turn complementary screens into shared molecular supervision for unseen-drug response prediction while preserving native gene measurements.
Figures & tables
| Method | OP3 | SciPlex | VCPI1 | VCPI2 | Novartis | Tahoe | P1 | P2 | Macro |
|---|---|---|---|---|---|---|---|---|---|
| Overall response | |||||||||
| Global Mean | 7.1 (1.1) | 17.8 (0.7) | 18.1 (0.3) | 15.5 (0.1) | 29.8 (0.8) | 20.3 (1.1) | 8.7 (0.0) | 4.1 (0.1) | 16.4 (0.2) |
| Linear | 28.9 (2.9) | 44.6 (1.4) | 12.7 (0.1) | 5.9 (0.5) | 25.4 (0.9) | 36.2 (2.7) | 15.6 (0.3) | 2.9 (0.3) | 23.3 (0.3) |
| Ridge | 39.0 (1.6) | 49.8 (0.6) | 18.5 (0.4) | 15.7 (0.2) | 30.7 (0.8) | 42.0 (1.0) | 15.6 (0.3) | 6.3 (0.1) | 29.5 (0.3) |
| chemCPA | 33.1 (0.7) | 44.1 (0.7) | 12.7 (0.1) | 11.0 (0.2) | 23.4 (1.6) | 36.8 (1.7) | 14.3 (0.2) | 6.0 (0.6) | 24.5 (0.2) |
| PRnet | 26.4 (1.5) | 44.3 (0.6) | 12.5 (3.2) | 13.4 (0.1) | 28.5 (0.3) | 33.1 (1.5) | 15.5 (0.2) | 5.1 (0.2) | 24.1 (0.6) |
| Method | Views | Pearson | MAE | PDS L1 | PDS L2 | PDS cosine | DE direction | Overlap @100 |
|---|---|---|---|---|---|---|---|---|
| Global Mean | 12 | 18.11 (0.21) | 13.16 (0.02) | 69.33 (0.15) | 67.44 (0.06) | 70.43 (0.23) | 83.49 (1.77) | 0.79 (0.02) |
| Linear † | 12 | 25.67 (0.43) | 9.51 (0.08) | 69.05 (0.43) | 67.01 (0.25) | 72.72 (0.32) | 74.36 (0.39) | 1.33 (0.05) |
| Ridge | 12 | 32.67 (0.43) | 6.48 (0.08) | 72.47 (0.14) | 70.58 (0.16) | 77.76 (0.06) | 82.32 (0.81) | 0.98 (0.06) |
| chemCPA † | 12 | 26.85 (0.26) | 6.99 (0.05) | 71.12 (0.41) | 69.76 (0.46) | 76.56 (0.45) | 53.39 (0.84) | 15.08 (0.17) |
| PRnet | 12 | 26.38 (0.73) | 7.21 (0.09) | 71.37 (0.69) | 69.31 (0.80) | 75.05 (0.57) | 53.74 (0.94) | 19.29 (0.19) |
| biolord | 12 | 31.23 (1.21) | 6.80 (0.18) | 72.19 (0.29) | 70.15 (0.37) | 76.43 (0.26) | 68.04 (0.32) | 0.98 (0.03) |
| Overall response | Drug contrast | |||||
|---|---|---|---|---|---|---|
| Dataset | S/S | S/J | J/S | J/J | S | J |
| OP3 | 39.66 | 39.41 | 40.44 | 40.10 | 2.50 | 7.16 |
| SciPlex | 45.36 | 46.25 | 46.37 | 47.18 | 9.46 | 9.58 |
| VCPI 1 | 33.36 | 33.33 | 33.27 | 33.50 | 2.34 | 3.37 |
| VCPI 2 | 33.46 | 33.31 | 33.52 | 33.61 | 2.24 | 2.32 |
| Novartis | 49.71 | 50.48 | 52.11 | 52.60 | 3.91 | 4.82 |
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Profiles | Molecules | Contexts | Full genes | HVG/landmark |
| OP3 | 1,813 | 138 | 4 | 5,198 | 2,000 |
| SciPlex | 4,974 | 186 | 3 | 20,251 | 2,000 |
| VCPI1 | 27,517 | 2,272 | 1 | 20,629 | 2,000 |
| VCPI2 | 18,139 | 1,488 | 1 | 20,629 | 2,000 |
| Novartis | 46,748 | 3,770 | 1 | 20,038 | 2,000 |
| Tahoe | 67,018 | 376 | 50 | 20,573 | 2,000 |
| Dataset | Eligible units | Repeat | Bison | Bison / repeat (%) |
|---|---|---|---|---|
| OP3 | 268–353 | 0.228 | 0.091 | 40.2 |
| SciPlex | 870–944 | 0.147 | 0.078 | 53.1 |
| VCPI1 | 2,498–2,692 | 0.030 | 0.024 | 80.2 |
| VCPI2 | 1,610–1,723 | 0.030 | 0.016 | 53.0 |
| Novartis | 9,276–9,430 | 0.284 | 0.039 | 13.9 |
| Tahoe | 3,010–3,492 | 0.298 | 0.056 | 18.5 |
| Method | View | OP3 | SciPlex | VCPI1 | VCPI2 | Novartis | Tahoe | P1 | P2 | Macro |
|---|---|---|---|---|---|---|---|---|---|---|
| Global Mean | Full | 6.9 (1.0) | 21.2 (0.6) | 20.5 (0.3) | 18.0 (0.1) | 32.2 (0.7) | 20.2 (0.9) | 8.7 (0.0) | 4.1 (0.1) | 16.4 (0.2) |
| HVG | 7.3 (1.1) | 14.3 (0.8) | 15.7 (0.3) | 13.1 (0.1) | 27.5 (0.8) | 20.4 (1.2) | ||||
| Linear | Full | 27.8 (2.3) | 45.9 (1.5) | 14.3 (0.1) | 6.8 (0.4) | 26.9 (0.8) | 35.6 (2.7) | 15.6 (0.3) | 2.9 (0.3) | 23.3 (0.3) |
| HVG | 30.0 (3.5) | 43.3 (1.4) | 11.0 (0.1) | 5.1 (0.6) | 23.8 (0.9) | 36.8 (2.8) | ||||
| Ridge | Full | 37.5 (1.3) | 50.9 (0.5) | 20.8 (0.4) | 17.9 (0.3) | 33.0 (0.8) | 41.6 (1.1) | 15.6 (0.3) | 6.3 (0.1) | 29.5 (0.3) |
| HVG | 40.5 (2.0) | 48.7 (0.6) | 16.3 (0.4) | 13.5 (0.2) | 28.5 (0.9) | 42.5 (0.9) |
| Method | View | OP3 | SciPlex | VCPI1 | VCPI2 | Novartis | Tahoe | P1 | P2 | Macro |
|---|---|---|---|---|---|---|---|---|---|---|
| Global Mean | Full | NA | NA | NA | NA | NA | NA | NA | NA | NA |
| HVG | NA | NA | NA | NA | NA | NA | ||||
| Linear | Full | 0.9 (1.5) | 4.5 (0.7) | 0.3 (0.3) | 0.1 (0.4) | 1.8 (0.3) | 1.9 (1.5) | 2.0 (0.4) | 0.5 (0.4) | 1.8 (0.1) |
| HVG | 0.9 (1.5) | 6.5 (1.2) | 0.4 (0.3) | 0.1 (0.5) | 2.1 (0.3) | 2.5 (1.9) | ||||
| Ridge | Full | 3.7 (4.1) | 6.6 (1.7) | 1.3 (0.4) | 1.3 (0.3) | 3.6 (0.3) | 2.0 (0.9) | 2.2 (0.4) | 1.9 (0.2) | 3.3 (0.3) |
| HVG | 4.6 (4.6) | 8.9 (2.2) | 1.7 (0.5) | 1.6 (0.3) | 4.3 (0.4) | 2.3 (1.0) |
| Predictor | Overall Pearson | Increment | Drug contrast |
|---|---|---|---|
| Context-response DLM | 0.4046 (0.0033) | – | – |
| Bison (two DLMs) | 0.4123 (0.0055) | (0.0051) | 0.0477 (0.0041) |
| Metric | Views | Uncalibrated | + amplitude | + detection zeros |
|---|---|---|---|---|
| Pearson | 12 | 0.4321 (0.0055) | 0.4336 (0.0055) | 0.4337 (0.0055) |
| MAE | 12 | 0.0537 (0.0006) | 0.0569 (0.0008) | 0.0568 (0.0008) |
| MSE | 12 | 0.0112 (0.0005) | 0.0120 (0.0005) | 0.0120 (0.0005) |
| PDS-L1 | 12 | 0.7028 (0.0030) | 0.7778 (0.0049) | 0.7782 (0.0048) |
| PDS-L2 | 12 | 0.6909 (0.0026) | 0.7647 (0.0052) | 0.7647 (0.0052) |
| PDS-cosine | 12 | 0.8430 (0.0040) | 0.8458 (0.0038) | 0.8458 (0.0038) |
| Method | Context–time | Plate matched | Views |
|---|---|---|---|
| Ridge | 0.2320 (0.0049) | 0.2954 (0.0034) | 14/14 |
| chemCPA | 0.1492 (0.0034) | 0.2445 (0.0019) | 14/14 |
| PRnet | 0.1603 (0.0025) | 0.2408 (0.0062) | 14/14 |
| biolord | 0.2029 (0.0113) | 0.2856 (0.0103) | 14/14 |
| PerturbNet | 0.1536 (0.0127) | 0.2400 (0.0051) | 14/14 |
| CellFlow | 0.2493 ∗ (0.0199) | 0.3288 ∗ (0.0110) | 12/14 |
| Dataset | Own-dataset pool | Eight-dataset pool | Change |
|---|---|---|---|
| OP3 | 0.121 | 0.079 | |
| SciPlex | 0.031 | 0.047 | |
| VCPI1 | 0.018 | 0.023 | |
| VCPI2 | 0.021 | 0.015 | |
| Novartis | 0.049 | 0.041 | |
| Tahoe | 0.047 | 0.036 |
Cross-Dataset Generalization
Cross-dataset generalization studies whether AI models retain accuracy, calibration, and usefulness on data from sources beyond their training set.
See all 135 papers