Multimodal Crystal Flow: Any-to-Any Modality Generation for Unified Crystal Modeling
Organizations: Graduate School of AI, KAIST, Seoul, South Korea · Materials Intelligence Lab, LG AI Research, Seoul, South Korea
Abstract
Crystal modeling spans a family of conditional and unconditional generation tasks, including crystal structure prediction (CSP) and de novo generation (DNG). While recent deep generative models have shown promising performance, they remain largely task-specific, lacking a unified framework that shares crystal representations across tasks. To address this limitation, we propose Multimodal Crystal Flow (MCFlow), a unified multimodal flow model that realizes multiple crystal generation tasks as distinct inference trajectories via independent time variables for atom types and crystal structures. To enable multimodal flow in a standard transformer model, we introduce a composition- and symmetry-aware atom ordering with hierarchical permutation augmentation, injecting compositional and crystallographic priors without explicit structural templates. Experiments on the MP-20 and MPTS-52 benchmarks show that a single MCFlow model is competitive with task-specific baselines across CSP, DNG, and structure-conditioned atom type generation.
Figures & tables
| Model | MP-20 | MPTS-52 | ||
|---|---|---|---|---|
| MR (%) | RMSE | MR (%) | RMSE | |
| CDVAE (1) | 33.90 | 0.1045 | 5.34 | 0.2106 |
| DiffCSP (1) | 51.49 | 0.0631 | 12.19 | 0.1786 |
| FlowMM (1) | 61.39 | 0.0566 | 17.54 | 0.1726 |
| CrystalFlow (1) | 62.02 | 0.0710 | 21.00 | 0.1613 |
| OMatG (1) | 63.75 | 0.0720 | 25.15 | 0.1931 |
| Model | # Params | Valid (%) | Unique (%) | Novel (%) | Energy-based | Stability | Metastability | ||||
| (eV) | (eV) | RMSD (Å) | Stable (%) | SUN (%) | Meta (%) | MSUN (%) | |||||
| With pre-relaxation | |||||||||||
| MatterGen | 47M | 95.7 | 95.1 | 70.5 | 2.0 | 0.2 (6) | 33.4 | 15.0 | |||
| PLaID++ | 7B | 96.0 | 77.8 | 24.2 | 12.4 | 1.0 (26) | 60.7 | 7.6 | |||
| WyFormer | 8B | 93.4 | 93.0 | 66.4 | 0.5 | 0.1 (3) | 15.7 | 1.9 | |||
| WyFormer-DFT | 8B | 95.2 | 95.0 | 66.4 | 3.7 | 0.4 (9) | 24.8 | 7.8 | |||
| Model | MP-20 | MPTS-52 | ||
|---|---|---|---|---|
| Comp (%) | MR (%) | Comp (%) | MR (%) | |
| CGCNN | 87.06 | 4.71 | 82.08 | 3.50 |
| FlowMM (1) | 83.39 | 2.40 | 76.12 | 0.88 |
| MCFlow-S (1) | 88.97 | 1.57 | 83.14 | 1.01 |
| MCFlow-B (1) | 90.17 | 3.12 | 83.56 | 1.20 |
| MCFlow-L (1) | 90.07 | 3.32 | 83.67 | 1.24 |
| Rank | AcGaO 3 (mask Ac) | Zr 4 Fe 4 Si 4 (mask Fe) | Mn 2 VGa (mask V) | Ca 2 In 4 O 8 (mask Ca) | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Element | Freq (%) | MP ID | Split | Element | Freq (%) | MP ID | Split | Element | Freq (%) | MP ID | Split | Element | Freq (%) | MP ID | Split | |
| 1 | Ac | 23 | 1183053 | Test | Co | 40 | 1102565 | Test | Mn | 23 | 999550 | — | Mn | 32 | 35162 | Train |
| 2 | Yb | 22 | 1187561 | — | Cu | 32 | 22522 | Train | V | 16 | 21235 | Test | Ca | 19 | 22766 | Test |
| 3 | Sr | 10 | — | Ni | 19 | 1103272 | Val | Nb | 15 | 1185972 | Train | Cd | 12 | 19803 | Val | |
| Model | MP-20 | MPTS-52 | ||||||
|---|---|---|---|---|---|---|---|---|
| MR | RMSE | Struct | Comp | MR | RMSE | Struct | Comp | |
| MCFlow | 63.14 | 0.0611 | 99.44 | 89.85 | 26.46 | 0.1572 | 98.34 | 85.57 |
| Inter | 60.41 | 0.0772 | 99.48 | 89.64 | 22.80 | 0.1927 | 98.12 | 85.20 |
| Intra | 58.54 | 0.1023 | 99.35 | 89.30 | 18.80 | 0.2231 | 97.70 | 84.83 |
| PosEmb | 54.83 | 0.0979 | 99.48 | 85.30 | 16.44 | 0.2105 | 98.20 | 75.20 |
Appendix figures & tables21 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Description |
|---|---|
| Infinite periodic crystal | |
| Number of atoms in the primitive unit cell | |
| Atom types sequence ( ) | |
| Fractional coordinates ( ) | |
| Cartesian coordinates ( ) | |
| Lattice matrix |
| Modality ( ) | Base dist. | Cond. target | Parameterization | Bregman div. |
|---|---|---|---|---|
| Atom type ( ) | ||||
| Frac. coord. ( ) | ||||
| Length ( ) | ||||
| Angle ( ) |
| Model | NG | CSP | ATG | ||||||
|---|---|---|---|---|---|---|---|---|---|
| MP-20 | MPTS-52 | MP-20 | MPTS-52 | ||||||
| MR (%) | RMSE | MR (%) | RMSE | Comp (%) | MR (%) | Comp (%) | MR (%) | ||
| MCFlow-S | ✗ | 54.40 | 0.1339 | 22.58 | 0.1880 | 88.89 | 1.53 | 83.19 | 0.98 |
| MCFlow-S | ✓ | 56.10 | 0.1269 | 22.88 | 0.1845 | 88.97 | 1.57 | 83.14 | 1.01 |
| MCFlow-B | ✗ | 62.11 | 0.0624 | 25.32 | 0.1640 | 90.05 | 2.69 | 84.29 | 1.09 |
| MCFlow-B | ✓ | 63.14 | 0.0611 | 26.46 | 0.1572 | 90.17 | 3.12 | 83.56 | 1.20 |
| Model scale | Small (S) | Base (B) | Large (L) |
|---|---|---|---|
| # Parameters | 34M | 134M | 464M |
| Hidden dimension | 384 | 768 | 1024 |
| Transformer layers | 12 | 12 | 24 |
| Attention heads | 6 | 12 | 16 |
| Hyperparameter | Value |
|---|---|
| Optimizer | AdamW |
| Learning rate | |
| Weight decay | 0.0 |
| Batch size | 256 |
| Max epochs | 10,000 |
| Precision | BF16 mixed precision |
| Hyperparameter | Value |
|---|---|
| Integration steps | 500 |
| Guidance scale | 2.0 (single-sample) |
| Noise level | 0.1 (single-sample) |
| Model | Params | Batch | Train (1 Epoch) | Infer (1 Step) |
|---|---|---|---|---|
| DiffCSP | 12.3M | 256 | 26.0s | 111.1ms |
| FlowMM | 28.3M | 256 | 52.11s | 240.7ms |
| MCFlow-S | 33.7M | 256 | 8.54s | 23.9ms |
| MCFlow-B | 134.0M | 256 | 22.27s | 68.7ms |
| MCFlow-L | 464.6M | 128 | 77.68s | 113.5ms |
| Split | Model | METRe (%) | RMSE | cRMSE |
|---|---|---|---|---|
| Polymorph | DiffCSP | 53.1 | 0.084 | 0.279 |
| FlowMM | 65.2 | 0.079 | 0.226 | |
| OMatG | 70.5 | 0.056 | 0.187 | |
| MCFlow-B | 70.7 | 0.068 | 0.195 | |
| Original | DiffCSP | 58.8 | 0.064 | 0.244 |
| FlowMM | 67.0 | 0.067 | 0.210 |
| Model | MP-20 | MPTS-52 | ||
|---|---|---|---|---|
| MR (%) | RMSE | MR (%) | RMSE | |
| DiffCSP++ | 80.27 | 0.0295 | 46.29 | 0.0896 |
| SGFM | 82.74 | 0.0288 | 51.79 | 0.0827 |
| MCFlow-S | 79.21 | 0.0238 | 73.91 | 0.0415 |
| MCFlow-B | 85.31 | 0.0210 | 77.61 | 0.0361 |
| MCFlow-L | 85.96 | 0.0201 | 74.63 | 0.0386 |
| Ordering | CSP | DNG | ||
|---|---|---|---|---|
| MR (%) | RMSE | Struct (%) | Comp (%) | |
| Atomic Number | 59.81 | 0.0951 | 99.30 | 88.09 |
| Rand. Perm. | 54.25 | 0.1184 | 99.45 | 86.12 |
| Electronegativity | 63.14 | 0.0611 | 99.44 | 89.85 |
| Model | MP-20 | MPTS-52 | ||
|---|---|---|---|---|
| MR (%) | RMSE | MR (%) | RMSE | |
| DiffCSP | 52.51 / 57.82 | 0.0600 / 0.0627 | 14.29 / 15.79 | 0.1489 / 0.1533 |
| FlowMM | 59.98 / 66.22 | 0.0629 / 0.0661 | 20.28 / 22.29 | 0.1486 / 0.1541 |
| OMatG | 63.75 / 69.83 | 0.0720 / 0.0741 | 25.15 / 27.38 | 0.1931 / 0.1970 |
| MCFlow-S | 56.10 / 61.78 | 0.1269 / 0.1321 | 22.88 / 24.74 | 0.1846 / 0.1920 |
| MCFlow-B | 63.14 / 69.23 | 0.0611 / 0.0663 | 26.46 / 28.77 | 0.1577 / 0.1610 |
| Model | Structural Validity (%) | Compositional Validity (%) |
|---|---|---|
| DiffCSP | 67.47 | 55.80 |
| SymmCD | 87.11 | 78.18 |
| DiffCSP++ | 99.87 | 77.52 |
| SGEquiDiff | 97.79 | 79.83 |
| MCFlow-S | 96.73 | 84.62 |
| MCFlow-B | 98.34 | 85.57 |
| Method | MR (%) | RMSE |
|---|---|---|
| CSP-only | 61.92 | 0.0638 |
| MCFlow-B w/o NG | 62.11 | 0.0624 |
| MCFlow-B | 63.14 | 0.0611 |
| Method | MR (%) | RMSE |
|---|---|---|
| DiffCSP DNG | 0 3.76 | 0.3396 |
| FlowMM DNG | 27.01 | 0.1947 |
| MCFlow-B coupled ( ) | 45.58 | 0.1499 |
| MCFlow-B | 63.14 | 0.0611 |
Crystal Structure Generation
Crystal structure generation uses computational models to create periodic atomic arrangements for predicting and designing materials.
See all 61 papers