JEPA for astronomy: multi-survey spectral alignment puts stellar parameters on the leading principal axes
Organizations: William H. Miller III Department of Physics & Astronomy, The Johns Hopkins University, Baltimore, MD 21218, USA · Department of Astronomy, The Ohio State University, 140 West 18th Avenue, Columbus, OH 43210, USA · Center for Cosmology and AstroParticle Physics (CCAPP), The Ohio State University, Columbus, OH 43210, USA · Max-Planck-Institut für Astronomie, Königstuhl 17, D-69117 Heidelberg, Germany ·
Abstract
Spectra from different surveys carry different systematics and are not calibrated against one another. Multi-survey foundation models for stellar spectra are then built by aligning embeddings of the same star observed across surveys. Most in astronomy follow the recipes established for language and vision, aligning with a contrastive loss that separates every star from the others. However, this does not ensure that the stellar physics is encoded in a form that a simple read-out can recover. Holding the cross-survey architecture fixed and varying only the alignment loss, we measure what an objective encodes from the principal-component geometry of the Gaia BP/RP (XP) spectra and from a linear probe of the stellar parameters. In a properly aligned embedding, the leading two principal components form a plane that recovers an analog of the Kiel diagram, the third component tracks [Fe/H], and [alpha/Fe] varies coherently across the plane, such that the chemically defined Galactic disks and accreted populations occupy distinct loci. We show that legibility, the ease of reading the information out, is highest for a training objective that never pushes stars apart, and instead constrains only the overall distribution of each survey's embeddings (JEPA). JEPA also exceeds the contrastive alternative at the same architecture, and the performance improves further as more surveys (Gaia XP+LAMOST LRS+DESI+APOGEE) are included. Predicted abundances for 8.0 million XP giants reproduce the main [alpha/Fe]-[Fe/H] structure of the Milky Way. These results indicate that the choice of alignment objective, not alignment alone, determines whether stellar labels are linearly recoverable.
Figures & tables
| Survey pair | Matched pairs | Used in | |
| Gaia XP | LAMOST LRS | all models | |
| Gaia XP | APOGEE | four-survey | |
| Gaia XP | DESI | four-survey | |
| DESI | LAMOST LRS | four-survey | |
| APOGEE | LAMOST LRS | four-survey | |
| APOGEE | DESI | four-survey | |
| parameter | JEPA (4 survey) | CLIP (4 survey) | JEPA (2 survey) | CLIP (2 survey) | AE | |
|---|---|---|---|---|---|---|
| ridge / MLP | ridge / MLP | ridge / MLP | ridge / MLP | ridge / MLP | ||
| 200 | 0.93 / 0.97 | 0.86 / 0.96 | 0.94 / 0.96 | 0.68 / 0.97 | 0.74 / 0.93 | |
| 10,000 | 0.95 / 0.98 | 0.93 / 0.98 | 0.96 / 0.99 | 0.93 / 0.98 | 0.95 / 0.98 | |
| 200 | 0.95 / 0.96 | 0.93 / 0.95 | 0.93 / 0.95 | 0.88 / 0.94 | 0.70 / 0.90 | |
| 10,000 | 0.98 / 0.98 | 0.97 / 0.98 | 0.97 / 0.98 | 0.96 / 0.98 | 0.94 / 0.96 | |
| [Fe/H] | 200 | 0.90 / 0.91 | 0.87 / 0.90 | 0.86 / 0.90 | 0.82 / 0.88 | 0.69 / 0.75 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
Latent Space Alignment
Latent space alignment maps learned representations into compatible coordinates to enable comparison, transfer, and interoperability across models or data sources.
See all 89 papers