Suiren-1.0 Technical Report: A Family of Molecular Foundation Models
Organizations: Shanghai Academy of AI for Science (SAIS)
Abstract
We introduce Suiren-1.0, a family of molecular foundation models for the accurate modeling of diverse organic systems. Suiren-1.0 comprising three specialized variants (Suiren-Base, Suiren-Dimer, and Suiren-ConfAvg) is integrated within an algorithmic framework that bridges the gap between 3D conformational geometry and 2D statistical ensemble spaces. We first pre-train Suiren-Base (1.8B parameters) on a 70M-sample Density Functional Theory dataset using spatial self-supervision and SE(3)-equivariant architectures, achieving robust performance in quantum property prediction. Suiren-Dimer extends this capability through continued pre-training on 13.5M intermolecular interaction samples. To enable efficient downstream application, we propose Conformation Compression Distillation (CCD), a diffusion-based framework that distills complex 3D structural representations into 2D conformation-averaged representations. This yields the lightweight Suiren-ConfAvg, which generates high-fidelity representations from SMILES or molecular graphs. Our extensive evaluations demonstrate that Suiren-1.0 establishes state-of-the-art results across a range of tasks. All models and benchmarks are open-sourced.
Figures & tables
| Training Hyperparameter | Value |
|---|---|
| Task Formulation | |
| Loss function | MAE |
| Train/validation split ratio (Random and Size-Stratified) | 0.8:0.2 |
| Optimization | |
| Mini-batch size per GPU | 8 |
| Optimizer | adamw |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| critical temperature | K | 27.3807/0.8340 | 9.3277/0.9787 | 30.6705/0.8850 | 6.6725 / 0.9803 | 28.47 |
| critical pressure | bar | 2.0733/0.9045 | 0.7332/0.9765 | 2.9769/0.9084 | 0.4953 / 0.9804 | 32.45 |
| critical density | g/ml | 0.0134/0.9253 | 0.0054/ 0.9814 | 0.0115/0.9497 | 0.0043 /0.9782 | 20.74 |
| critical volume | cm3/mol | 61.8034/0.8484 | 8.6329/0.9981 | 7.0201/0.9989 | 3.5884 / 0.9994 | 48.88 |
| critical compressibility | cm3 | 0.0189/0.6178 | 0.0066/0.8858 | 0.0098/0.8808 | 0.0053 / 0.9127 | 19.70 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| flash point | F | 19.6978/0.8017 | 9.9274/0.9472 | 13.9535/0.9438 | 8.2072 / 0.9645 | 17.33 |
| lower explosive limit | vol% | 0.1689/0.6854 | 0.0974/ 0.8926 | 0.1106/0.8341 | 0.0871 /0.8599 | 10.59 |
| upper explosive limit | vol% | 1.4188/0.5846 | 1.0460/0.6979 | 1.0023/0.6942 | 0.7811 / 0.8423 | 22.07 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| heat capacity of liquid | J/mol/K | 16.0687/0.7922 | 5.9321/0.9812 | 5.8939/0.9792 | 4.2184 / 0.9861 | 28.43 |
| heat capacity of solid | J/mol/K | 49.2807/0.9499 | 6.5306/0.9988 | 3.2724/0.9990 | 1.0669 / 0.9997 | 67.40 |
| coefficient of thermal expansion of liquid | 1/K | 0.0002/0.1716 | 0.0001/0.8158 | 0.0001/0.6211 | 0.0000 / 0.9256 | 60.00 |
| heat capacity of gas | J/mol/K | 24.1482/0.8849 | 4.4112/0.9685 | 3.2478/ 0.9691 | 2.6712 /0.9690 | 17.75 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| octanol water partition coefficient | – | 0.3786/0.9414 | 0.1491/0.9877 | 0.1386/0.9858 | 0.1203 / 0.9897 | 13.20 |
| solubility in water | ppm(wt) | 0.2110/0.9422 | 0.0564/0.9973 | 0.0456/ 0.9980 | 0.0387 /0.9972 | 15.07 |
| solubility in water containing salt | ppm(wt) | 0.2535/0.7540 | 0.0615/0.9924 | 0.0406 / 0.9961 | 0.0447/0.9931 | -10.07 |
| solubility parameter | (J/cm3) 1/2 | 0.7111/0.8331 | 0.3873/0.9236 | 0.7614/0.8282 | 0.3368 / 0.9300 | 13.04 |
| henrys law constant for compound in water | – | 0.2856/0.9581 | 0.1517/0.9816 | 0.1930/0.9744 | 0.1318 / 0.9817 | 13.09 |
| henrys law constant for gas in water | – | 0.5454/0.3000 | 0.3017/0.7939 | 0.1773 / 0.9430 | 0.3234/0.6547 | -82.37 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| melting point | K | 19.9979/0.8199 | 14.1449/0.9053 | 24.7538/0.8050 | 11.0789 / 0.9171 | 21.68 |
| boiling point | K | 19.8744/0.8891 | 6.2177/0.9906 | 12.3314/0.9777 | 4.3259 / 0.9933 | 30.43 |
| vapor pressure | mmHg | 0.4837/0.5674 | 0.1596/0.9579 | 0.2000/0.9370 | 0.1365 / 0.9605 | 14.47 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| density of liquid | g/ml | 0.0331/0.9544 | 0.0160/0.9761 | 0.0145/ 0.9763 | 0.0120 /0.9622 | 17.03 |
| acentric factor | omega | 0.0702/0.7591 | 0.0233/0.9293 | 0.0225/ 0.9312 | 0.0169 /0.9043 | 24.71 |
| refractive index | - | 0.0277/0.4260 | 0.0057/0.9314 | 0.0079/0.9276 | 0.0046 / 0.9529 | 20.18 |
| radius of gyration | m | 0.3573/0.6317 | 0.1230/0.9715 | 0.1204/0.9757 | 0.1085 / 0.9803 | 9.92 |
| dipole moment | D | 0.4022/0.6638 | 0.2987 / 0.8115 | 0.3256/0.7585 | 0.3326/0.7610 | -11.36 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| entropy of formation | J/mol/K | 90.1219/0.8775 | 16.6006/0.9975 | 11.1386/0.9982 | 7.5413 / 0.9983 | 32.30 |
| gibbs energy of formation | J/mol | 32.5168/0.9365 | 8.3799/0.9865 | 19.1059/0.9785 | 4.6748 / 0.9972 | 44.21 |
| helmholtz energy of formation | kJ/mol | 30.2883/0.9286 | 7.9805/ 0.9829 | 24.8331/0.9656 | 5.4749 /0.9746 | 31.40 |
| internal energy of formation | kJ/mol | 34.2535/0.8869 | 10.3932/0.9795 | 36.3480/0.9393 | 5.7416 / 0.9950 | 44.76 |
| enthalpy of vaporization | kJ/mol | 3.3764/0.7398 | 1.3875/0.9694 | 1.2207/ 0.9773 | 1.0592 /0.9759 | 13.23 |
| enthalpy of fusion | J/mol/K | 3.3815/0.8819 | 1.2265/0.9898 | 1.3044/0.9888 | 0.8394 / 0.9899 | 31.56 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| viscosity of liquid | mp | 0.8216/0.5870 | 0.4716/0.8328 | 0.9996/0.5924 | 0.3192 / 0.8905 | 32.32 |
| thermal conductivity of gas | W/m/K | 0.0019/0.2592 | 0.0003/ 0.9584 | 0.0006/0.9293 | 0.0002 /0.9572 | 20.00 |
| thermal conductivity of liquid | W/m/K | 0.0107/0.0565 | 0.0028/0.7911 | 0.0036/ 0.8183 | 0.0027 /0.7895 | 4.29 |
| diffusion coefficient at infinite dilution in water | cm2/s | 0.0000 /-1.2725 | 0.0000 /0.9865 | 0.0000 /0.9817 | 0.0000 / 0.9904 | - |
| diffusion coefficient in air | cm2/s | 0.0066/0.6975 | 0.0014/0.9845 | 0.0011/0.9858 | 0.0009 / 0.9878 | 17.27 |
| Property | Unit | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|---|
| surface tension | dynes/cm | 1.5226/0.8367 | 1.0414/0.8951 | 1.7084/0.8563 | 0.8205 / 0.9218 | 21.21 |
| hydration free energy | kJ/mol | 0.8510/0.8748 | 0.4545/ 0.9646 | 0.4627/0.9623 | 0.4521 /0.9630 | 0.52 |
| Property | ChemProp | DeepAutoQSAR | DeepPurpose | Uni-QSAR | Suiren-ConfAvg |
|---|---|---|---|---|---|
| Caco2 | 0.3900 | 0.3060 | 0.3930 | 0.2730 | 0.3037 |
| Lipophilicity | 0.4370 | 0.4760 | 0.5740 | 0.4200 | 0.3865 |
| AqSol | 0.8200 | 0.7840 | 0.8270 | 0.6770 | 0.6794 |
| PPBR | 7.9930 | 8.0430 | 9.9940 | 7.5300 | 8.3963 |
| LD50 | 0.5480 | 0.5900 | 0.6780 | 0.5530 | 0.5317 |
| Property | ChemProp | DeepAutoQSAR | DeepPurpose | Uni-QSAR | Suiren-ConfAvg |
|---|---|---|---|---|---|
| HIA | 0.9790 | 0.9820 | 0.9720 | 0.9920 | 0.9963 |
| Pgp | 0.9020 | 0.9170 | 0.9180 | 0.9340 | 0.9351 |
| Bioavailability | 0.6230 | 0.6820 | 0.6720 | 0.7320 | 0.7363 |
| BBB | 0.8820 | 0.8760 | 0.8890 | 0.9250 | 0.9236 |
| CYP3A4 Substrate | 0.6100 | 0.6420 | 0.6390 | 0.6450 | 0.6286 |
| hERG | 0.7500 | 0.8450 | 0.8410 | 0.8560 | 0.8816 |
| Property | ChemProp | DeepAutoQSAR | DeepPurpose | Uni-QSAR | Suiren-ConfAvg |
|---|---|---|---|---|---|
| CYP2C9 Inhibition | 0.7700 | 0.7920 | 0.7420 | 0.8010 | 0.7845 |
| CYP2D6 Inhibition | 0.6640 | 0.7020 | 0.6160 | 0.7430 | 0.6725 |
| CYP3A4 Inhibition | 0.8700 | 0.8830 | 0.8290 | 0.8880 | 0.8740 |
| CYP2C9 Substrate | 0.3910 | 0.3950 | 0.3800 | 0.4540 | 0.5177 |
| CYP2D6 Substrate | 0.6880 | 0.7030 | 0.6770 | 0.7210 | 0.7289 |
Appendix figures & tables9 assets
Supplementary material from the paper’s appendix.
Appendix
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Critical Compressibility | 0.03447 | 0.03632 | 0.03527 | 0.00907 | 73.69 |
| Critical Density | 0.00671 | 0.00720 | 0.00734 | 0.00888 | -23.33 |
| Critical Pressure | 1.73699 | 3.27665 | 2.63610 | 1.65567 | 4.68 |
| Critical Temperature | 77.96931 | 63.34677 | 87.88906 | 19.59443 | 69.07 |
| Critical Volume | 351.31897 | 290.12731 | 321.89835 | 55.80474 | 80.77 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Flash Point | 32.80089 | 20.89532 | 36.13503 | 14.83841 | 28.99 |
| Lower Explosive Limit | 0.10239 | 0.05315 | 0.10274 | 0.03367 | 36.65 |
| Upper Explosive Limit | 0.74490 | 0.59120 | 0.62222 | 0.34410 | 41.80 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Heat Capacity Of Gas | 144.17387 | 88.39811 | 146.68384 | 24.45830 | 72.33 |
| Heat Capacity Of Liquid | 60.96739 | 26.91383 | 40.76889 | 15.74570 | 41.50 |
| Heat Capacity Of Solid | 61.55533 | 43.78053 | 71.91361 | 4.97646 | 88.63 |
| Coefficient Of Thermal Expansion Of Liquid | 0.00010 | 0.00005 | 0.00009 | 0.00004 | 20.00 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Octanol Water Partition Coefficient | 0.68611 | 0.29471 | 0.44365 | 0.19774 | 32.90 |
| Solubility In Water | 0.32445 | 0.08128 | 0.28590 | 0.07426 | 8.64 |
| Solubility In Water Containing Salt | 0.25057 | 0.09037 | 0.17057 | 0.06786 | 24.91 |
| Solubility Parameter | 1.36914 | 1.53168 | 1.41960 | 0.75884 | 44.58 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Boiling Point | 66.21946 | 53.40313 | 70.61806 | 21.18527 | 60.33 |
| Melting Point | 39.98979 | 42.88753 | 51.46680 | 40.24486 | -0.00 |
| Vapor Pressure | 1.21508 | 0.89771 | 1.08963 | 0.47305 | 47.30 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Density Of Liquid | 0.01929 | 0.01221 | 0.01210 | 0.00851 | 29.67 |
| Acentric Factor | 0.09174 | 0.07457 | 0.08191 | 0.06685 | 10.35 |
| Radius Of Gyration | 1.15782 | 0.53795 | 0.73237 | 0.22784 | 57.65 |
| Refractive Index | 0.01290 | 0.00859 | 0.00974 | 0.00673 | 21.65 |
| Dipole Moment | 0.64795 | 0.49490 | 0.53720 | 0.57567 | -7.16 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Gibbs Energy Of Formation | 99.86093 | 52.53548 | 74.17537 | 6.85050 | 86.96 |
| Helmholtz Energy Of Formation | 109.97257 | 73.68592 | 86.25709 | 6.48666 | 91.20 |
| Internal Energy Of Formation | 149.43255 | 90.63668 | 135.46958 | 11.44695 | 87.37 |
| Enthalpy Of Combustion | 4411.49423 | 3173.83835 | 3606.45797 | 338.80971 | 89.32 |
| Enthalpy Of Formation | 186.20484 | 123.64866 | 135.32938 | 11.15240 | 90.98 |
| Enthalpy Of Fusion | 13.58065 | 14.34938 | 15.46400 | 2.60221 | 80.84 |
| Property | Mole-BERT | Unimolv1 | Unimolv2 | Suiren-ConfAvg | Improvement (%) |
|---|---|---|---|---|---|
| Thermal Conductivity Of Gas | 0.00227 | 0.00139 | 0.00148 | 0.00072 | 48.20 |
| Thermal Conductivity Of Liquid | 0.00331 | 0.00276 | 0.00316 | 0.00203 | 26.45 |
| Diffusion Coefficient At Infinite Dilution In Water | 0.00000 | 0.00000 | 0.00000 | 0.00000 | 0.00 |
| Diffusion Coefficient In Air | 0.00487 | 0.00418 | 0.00363 | 0.00322 | 11.29 |
| Viscosity Of Liquid | 1.71584 | 1.40034 | 1.83852 | 1.27413 | 9.01 |
| Property | Baselines | Suiren-ConfAvg | Suiren-ConfAvg | w/o. |
|---|---|---|---|---|
| only ( ) | only ( ) | Suiren-ConfAvg | ||
| Critical Temperature | 6.6725 | 8.6190 | 7.3257 | 7.9764 |
| Flash Point | 8.2072 | 9.5567 | 8.8750 | 9.2798 |
| Melting Point | 11.0789 | 12.7397 | 12.4325 | 12.7382 |
| Surface Tension | 0.8205 | 0.9020 | 0.8568 | 0.9123 |