PXRD-Bench: How Close Are We to Determining Crystal Structures from Powder Diffraction?
Organizations: Korea Advanced Institute of Science & Technology (kaist.edu) · Massachusetts Institute of Technology (mit.edu)
Abstract
Determining crystal structures from powder X-ray diffraction (PXRD) would enable routine characterization of newly synthesized materials, including those absent from reference databases. Generative models offer a promising approach, but existing evaluations remain fragmented and largely assume single-phase samples with known composition. To fill this gap, we introduce PXRD-Bench, a unified benchmark that extends evaluation to unknown per-element atom counts and recovery of both structures in two-phase mixtures. It provides approximately 4.1 million training structures with simulated PXRD, tests generalization to unseen compositions and structural prototypes, and evaluates recovery from experimental PXRD after excluding structurally matching training entries. To provide a strong reference baseline, we also introduce Bragglite, a PXRD-to-structure model developed through a systematic study of PXRD modeling choices. It achieves a 44.2% Top-1 match rate on experimental RRUFF patterns with known composition, 24.6% above the strongest prior baseline. Further analysis yields several key findings: some models fail to benefit from experimental PXRD, while generalization to unseen structural prototypes and recovery from two-phase mixtures remain challenging. Together, our benchmark, systematic studies, and Bragglite clarify the capabilities and limitations of current PXRD-to-structure models.
Figures & tables
| Simulated PXRD | RRUFF | opXRD | |||||
| Dataset | Model | Top-1 | Top-20 | Top-1 | Top-20 | Top-1 | Top-20 |
| MP-20 | Chemical input: exact stoichiometry | ||||||
| PXRDGen | 54.75 | 77.99 | 30.80 3.27 0 | 57.00 1.41 0 | 30.00 1.96 0 | 36.43 0.98 0 | |
| RealPXRD-Solver | 56.35 | 80.61 | 27.80 4.76 0 | 51.20 1.10 0 | 27.14 0.80 0 | 36.07 0.80 0 | |
| XRDiff | 55.10 | 78.11 | 17.80 0.84 0 | 39.80 0.84 0 | 21.07 3.87 0 | 31.43 2.04 0 | |
| Crystalyze | 29.32 | 48.03 | 0 5.00 1.58 0 | 14.80 1.48 0 | 11.07 1.49 0 | 17.86 1.79 0 | |
| Pair OOD | Prototype OOD | Composition OOD | ||||
| Model | Top-1 | Top-20 | Top-1 | Top-20 | Top-1 | Top-20 |
| Chemical input: exact stoichiometry | ||||||
| PXRDGen | 62.40 | 89.98 | 7.55 | 33.97 | 63.80 | 89.61 |
| RealPXRD-Solver | 58.94 | 88.88 | 3.31 | 17.52 | 62.90 | 90.66 |
| XRDiff | 47.48 | 83.87 | 2.36 | 18.51 | 50.13 | 84.16 |
| Crystalyze | 16.06 | 39.53 | 0.58 | 3.19 | 14.00 | 36.91 |
Appendix figures & tables16 assets
Supplementary material from the paper’s appendix.
Appendix
| Source | Snapshot | Selection criteria | Record counts | |
|---|---|---|---|---|
| Candidates | Final corpus | |||
| Materials Project | 2026-04-13 | 100,384 | 77,493 | |
| OQMD | v1.5 (2021-10) | Signed stability ; negative values retained | 219,945 | 166,102 |
| Alexandria | PBE 3D, 2025-07-02 | 2,331,796 | 2,139,337 | |
| AFLOW | AFLUX, 2026-08-16 | No energy filter | 2,981,679 | 1,879,759 |
| Total | 5,633,804 | 4,262,691 | ||
| Input feature | MP-20 | RRUFF | opXRD |
|---|---|---|---|
| Peak-position representation | |||
| 60.94 | 36.67 1.86 0 | 36.67 6.18 0 | |
| 59.96 | 39.17 2.28 0 | 35.83 2.28 0 | |
| 64.84 | 41.25 1.74 0 | 37.50 2.95 0 | |
| Additional peak features | |||
| prominence, width | 66.21 | 43.33 2.28 0 | 41.67 4.17 0 |
| Top-1 | Top-20 | Top-1 (pp) | |
|---|---|---|---|
| Bragglite | 78.86 0.40 0 | 90.62 0.40 0 | – |
| In-context fusion | 78.64 0.34 0 | 90.33 0.28 0 | |
| GEM | 76.35 0.59 0 | 89.90 0.05 0 |
| PXRD encoder | Top-1 | Top-20 |
|---|---|---|
| Transformer encoder | 75.37 | 89.04 |
| MLP encoder | 72.70 | 87.96 |
| Dominant | Minor | All-phase | |||||
|---|---|---|---|---|---|---|---|
| Dataset | Model | Top-1 | Top-20 | Top-1 | Top-20 | Top-1 | Top-20 |
| MP-20 | MatterGen | 14.28 | 55.69 | 15.48 | 55.41 | 2.13 | 30.67 |
| XRDiff | 25.28 | 38.28 | 23.14 | 36.48 | 6.76 | 14.64 | |
| Bragglite | 33.99 | 48.78 | 30.59 | 45.02 | 13.26 | 25.34 | |
| GALAXI | MatterGen | 0.00 | 76.19 | 4.76 | 71.43 | 0.00 | 42.86 |
| XRDiff | 28.57 | 38.10 | 9.52 | 14.29 | 0.00 | 9.52 | |
| Simulated PXRD | RRUFF | opXRD | |||||
| Dataset | Model | Top-1 | Top-20 | Top-1 | Top-20 | Top-1 | Top-20 |
| MP-20- polymorph- split | Chemical input: exact stoichiometry | ||||||
| PXRDGen | 55.43 | 78.92 | 30.00 3.08 0 | 59.00 1.41 0 | 24.29 1.60 0 | 36.79 2.04 0 | |
| RealPXRD-Solver | 57.42 | 79.54 | 26.60 2.61 0 | 47.80 2.68 0 | 24.64 1.49 0 | 33.21 1.60 0 | |
| XRDiff | 60.26 | 77.54 | 23.00 2.35 0 | 45.60 1.52 0 | 18.93 2.71 0 | 29.29 1.60 0 | |
| Crystalyze | 31.07 | 49.46 | 0 2.00 1.41 0 | 11.00 1.22 0 | 11.79 0.98 0 | 17.50 0.80 0 | |
| Component | Known composition | Element set |
|---|---|---|
| Backbone | ||
| Hidden dimension | 512 | |
| Transformer layers | 14 | |
| Attention heads | 16 | |
| FFN expansion ratio | 4 | |
| FFN activation | GELU | |
| Known composition | Element set | |
|---|---|---|
| Loss weights | ||
| EDM | ||
| EDM |
| Known composition | Element set | |
|---|---|---|
| Learning rate | ||
| LR schedule | Constant | Cosine decay |
| Warmup steps | 1,000 | 500 |
| MP-20 | PXRD-Bench | |
|---|---|---|
| Maximum atom count | 20 | 52 |
| Training steps | 800K | 4M |
| Approx. epochs | 15K | 250 |
| Batch size | 512 | 256 |
| GPUs / gradient accumulation | 1 / 1 | 1 / 1 |
| Training seed | 123 | 123 |
| Setting | Value |
|---|---|
| Training steps | 200K ( 3,846 epochs) |
| Checkpoint | Final 200K-step EMA checkpoint |
| Training seed (representation) | |
| Training seeds (augmentation) | |
| Sampling seeds | per training run |
| Setting | Known composition | Element set |
|---|---|---|
| Solver / steps | Heun / 150 | |
| Noise schedule | Karras, | |
| 60 | ||
| Churn range | ||
| 1.003 | ||
| 0.3 | ||
| Training data / input | Batch size | Steps | Time (h) | Peak memory (GiB) |
|---|---|---|---|---|
| PXRD-Bench / Known composition | 256 | 4M | 200.18 | 7.97 |
| PXRD-Bench / Element set | 256 | 4M | 201.29 | 7.98 |
| MP-20 / Known composition | 512 | 800K | 37.10 | 7.15 |
| MP-20 / Element set | 512 | 800K | 37.89 | 7.16 |
Crystal Structure Prediction
Crystal structure prediction seeks stable atomic arrangements from composition, molecular identity, or experimental measurements.
See all 32 papers