Organizations: Mathematics and Computer Science Division, Argonne National Laboratory, Lemont, IL 60439 · High Energy Physics Division, Argonne National Laboratory, Lemont, IL 60439, USA · Computational Science Division, Argonne National Laboratory, Lemont, IL 60439 · Computational Science Center, Data, Analysis and Visualization Group, National Renewable Energy Laboratory, Golden, CO, USA
Deep generative models (DGMs) compress high-dimensional data but often entangle distinct physical factors in their latent spaces. We present an auxiliary-variable-guided framework for disentangling representations of thermal Sunyaev-Zel'dovich (tSZ) maps of dark matter halos. We introduce halo mass and concentration as auxiliary variables and apply a lightweight alignment penalty to encourage latent dimensions to reflect these physical quantities. To generate sharp and realistic samples, we extend latent conditional flow matching (LCFM), a state-of-the-art generative model, to enforce disentanglement in the latent space. Our Disentangled Latent-CFM (DL-CFM) model recovers the established mass-concentration scaling relation and identifies latent space outliers that may correspond to unusual halo formation histories. By linking latent coordinates to interpretable astrophysical properties, our method transforms the latent space into a diagnostic tool for cosmological structure. This work demonstrates that auxiliary guidance preserves generative flexibility while yielding physically meaningful, disentangled embeddings, providing a generalizable pathway for uncovering independent factors in complex astronomical datasets.
Figures & tables
Methods
# Params.
Sinkhorn ( ↓ )
Energy ( ↓ )
Gaussian ( ↓ )
Laplacian ( ↓ )
ICFM
34.42M
4564.03 ± 37.883
84.073 ± 0.797
0.00813 ± 0.00020
0.00693 ± 0.00011
DL-CFM
38.06M
4819.211 ± 32.718
83.148 ± 0.767
0.00813 ± 0.00014
0.00678 ± 0.00012
Table 1: Table shows the generation quality for ICFM and DL-CFM in terms of different distance metrics (mean ± Sd). In terms of most metrics, the two approaches show similar generation quality.
Figure 3: Generating samples from the center (top) and tail (bottom) of the reconstruction-focused latents zrec , with the first two auxiliary-guided coordinates fixed at (z1,z2)=(0.001,0.001) .
Appendix figures & tables7 assets
Supplementary material from the paper’s appendix.
Appendix
Figure A.1: Schematic of the DL-CFM inference. Given a training sample, we fix the sampled latent from the disentangled latent space. The latent variable is used in the vector field network to evolve the source samples to the data distribution. For demonstration, we show two snapshots of the iterative reverse process at t=0.5 (left) and t=1 (right) using the vector field U-Net.
Hyperparameters
tSZ data
Train set size
10,142
# steps
240K
Training batch size
128
Optimizer
Adam
Learning rate
2e-4
Latent dimension
256
Appendix
Table A.1: Hyperparameter settings used for DL-CFM model training on the tSZ dataset.
Figure A.2: Generating samples from the center of the reconstruction-focused latents zrec , with the first two auxiliary-guided coordinates fixed at (z1,z2)=(0.001,0.9) - low-mass high-concentration setting .
Figure A.3: Generating samples from the tail of the reconstruction-focused latents zrec , with the first two auxiliary-guided coordinates fixed at (z1,z2)=(0.001,0.9) - low-mass high-concentration setting .
Figure A.4: Generating samples from the center of the reconstruction-focused latents zrec , with the first two auxiliary-guided coordinates fixed at (z1,z2)=(0.9,0.001) - high-mass low-concentration setting .
Figure A.5: Generating samples from the tail of the reconstruction-focused latents zrec , with the first two auxiliary-guided coordinates fixed at (z1,z2)=(0.9,0.001) - high-mass low-concentration setting .
Figure A.6: The auxiliary-guided latents maintain the inter-dependency between halo mass and concentration, yielding consistent M200c – c200c dependency structure.
Galaxy clusters are powerful probes of astrophysics and cosmology through gravitational lensing: the clusters' mass, dominated by 85% dark matter, distorts background light. Yet, mass reconstruction lacks the scalability and large-scale benchmarks to process the hundreds of thousands of clusters expected from forthcoming wide-field surveys. We introduce a fully automated method to reconstruct cluster surface mass density from photometry and gravitational lensing observables. Central to our approach is DarkClusters-15k, our new dataset of 15,000 simulated clusters with paired mass and photometry maps, the largest benchmark to date, spanning multiple redshifts and simulation frameworks. We train a plug-and-play diffusion prior on DarkClusters-15k that learns the statistical relationship between mass and light, and draw posterior samples constrained by weak- and strong-lensing observables; this yields principled reconstructions driven by explicit physics, alongside well-calibrated uncertainties. Our approach requires no expert tuning, runs in minutes rather than hours, achieves higher accuracy, and matches expertly-tuned reconstructions of the MACS 1206 cluster. We release our method and DarkClusters-15k to support development and benchmarking for upcoming wide-field cosmological surveys.
Diego Royo, Brandon Zhao, Adolfo Muñoz +2
Universidad de Zaragoza–I3A, Spain · California Institute of Technology, USA
Reconstructing the three-dimensional distribution of dark matter from weak-lensing observations is a central but highly ill-posed inverse problem in cosmology. Unlike standard 3D reconstruction with multiple viewpoints, we observe the universe from a single line of sight, through noisy shape distortions of galaxies with uncertain distances, so meaningful recovery of the 3D matter field requires strong prior assumptions. Existing methods either produce point estimates with handcrafted priors or use neural ensembles for approximate Bayesian uncertainty, and struggle to capture the non-Gaussian, filamentary structure of the cosmic web. With the advent of new high-resolution cosmological simulations, we now have an alternative source of prior knowledge that captures the nonlinear statistics of structure formation with far greater fidelity than analytic prescriptions. We leverage these simulations to build a new dataset Conicus3D, which enables us to learn a data-driven diffusion-model prior capturing the full 3D distribution of dark matter structure across cosmic time. Building on recent plug-and-play approaches, we modify a diffusion-based posterior sampling scheme to the 3D weak-lensing setting, combining the learned prior with a differentiable physical forward model. On realistic simulations targeting a modern weak lensing survey, our approach yields substantially improved 2D and 3D reconstruction accuracy over baseline methods. Moreover, it produces posterior samples whose statistics closely track the underlying simulations, while remaining robust to moderate shifts in cosmology.
Brandon Zhao, Diana Scognamiglio, Olivier Doré +1
Department of Computing and Mathematical Sciences, California Institute of Technology · Jet Propulsion Laboratory, California Institute of Technology · Department of Physics, Duke University +1
Learning the compositional nature of the physical world requires joint observation of interacting factors. However, because practical data is often decentralized, these factors are fragmented across isolated silos. Existing decentralized generative approaches focus only on modeling the union of siloed data, overlooking novel combinations implied by the collective whole. To bridge this gap, we introduce Decentralized Compositional Flow Matching (DCFM), a framework that enforces structural constraints across the global set of generative factors, without exchanging any raw data. DCFM enables novel combinations to emerge through peer interactions, even when no single data source can independently support the composition. Empirically, DCFM substantially outperforms federated learning and mixture-of-experts baselines across conditional image generation, robotic spatial planning, and medical attribute co-occurrence modeling.
Mashrur M. Morshed, Vishnu Naresh Boddeti
Department of Computer Science and Engineering, Michigan State University, East Lansing, MI, USA.