Track finding and particle identification performance with particle physics foundation models
Authors: Shuhang Li, Haiwang Yu, Gabor Galgoczi, Yeonju Go, Yi Huang, David Park, Michael Peters, Christopher Pinkenburg, Christof Roland, Jin Huang, Yihui Ren, Joseph D. Osborn
Organizations: Columbia University, New York, NY 10027, USA · Brookhaven National Laboratory, Upton, NY 11973, USA · State University of New York, Stony Brook, New York, NY 11794, USA · Massachusetts Institute of Technology, Cambridge, MA 02139, USA
Modern high energy nuclear and particle physics experiments produce large amounts of sparse data that must be reduced significantly in size before performing physics analysis. Recently, there has been an effort to evaluate Foundation Models as a potential tool for performing data analysis. These models have been shown to learn features in high dimensional datasets based on the multi-modal data they are trained on. To show their effectiveness at performing complex pattern recognition tasks, such as reconstructing charged particles in a magnetic field, we evaluated the performance of a Foundation Model based reconstruction on several downstream tasks with a dataset composed of spacepoints in a Time Projection Chamber. We show that the performance of the Foundation Model based data analysis significantly improves upon that of traditional methods, and furthermore can be adapted to learn additional tasks that are not necessarily related to the initial training objective.
Figures & tables
Figure 1: The track finding efficiency for the FM and the Cellular Automaton based seeding is shown as a function of pT . The FM based seeding algorithm surpasses the CA seeder performance at low pT by a significant margin.
Figure 2: The track finding purity for the FM and the Cellular Automaton based seeding is shown as a function of pT .
Figure 3: One-vs-rest PID ROC curves for pions (left), kaons (middle), and protons (right) in the momentum slice p∈[0.8,1.2) GeV/ c , comparing the FM4NPP model (blue) with the traditional GPR dE/dx baseline (red). The dashed diagonal denotes random performance, and the area under each curve (AUC) is quoted in the legend. Both methods are evaluated on the same reconstructed tracks matched to primary particles. Tracks are charge-folded and the classification is restricted to the π/K/p hypotheses for both methods.
Foundation models are increasingly being pursued in particle and nuclear physics, but existing approaches remain strongly tied to individual experiments through detector-specific architectures or pre-training objectives, limiting their reuse across sensing modalities. We show that a point cloud self-distillation framework yields a substantially more general sensor-level pre-training recipe. We show that the same refined architecture and objective can be independently pre-trained with minimal changes on three qualitatively different detector modalities: liquid argon time projection chamber (LArTPC), collider TPC, and water Cherenkov. Using 1,000 labeled images for downstream task adaptation, Panda V2 matches or exceeds specialized foundation-model baselines trained with orders of magnitude more supervision, matching state-of-the-art particle-clustering performance with 70x fewer labeled events on sPHENIX while substantially improving particle identification, and on LArTPC data matching Panda (arXiv:2512.01324) particle reconstruction with up to 1,000x fewer labels. Beyond reconstruction, simple linear probes reveal physically meaningful latent structure associated with particle causality and track curvature.
Samuel Young, César Jesús-Valls, Kazuhiro Terao
Stanford University · Stanford, CA 94305 · European Organization for Nuclear Research (CERN) +3
Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step toward a general-purpose foundation model for particle physics, we investigate whether the OmniLearned and ParticleViT foundation models pretrained on diverse high-Q2 simulated and real pp and ep collisions retain useful knowledge to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino--nucleus scattering events and evaluate pretrained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states (CC1π±, CCNπ±, and CC1π0). Pretrained OmniLearned and ParticleViT models outperform similarly sized models trained from scratch at the same compute budget, with the largest gains for OmniLearned on regression and for ParticleViT on classification. When the same transformer architecture is instead initialized from unrelated text pretraining (BERT), this advantage appears only marginally for classification in terms of compute efficiency and not in any way for regression. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward detector-agnostic inference in particle physics.
Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman +1
Department of Physics, Stanford University, Stanford, CA 94305, USA · Nagoya University, Kobayashi-Maskawa Institute, Aichi 464-8602, Japan · Fundamental Physics Directorate, SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA +1
The workflow from particle collision to physics analysis passes through a series of reconstruction steps that are traditionally modular and disconnected, with no shared representation linking low-level detector data to high-level analysis tasks. We show that casting event reconstruction as a machine learning problem naturally produces such a shared representation. We repurpose a machine learning model trained for particle-flow reconstruction (MLPF) to perform three distinct analysis tasks: jet flavor identification, jet energy regression, and missing momentum regression. By appending the per-particle latent representations learned during reconstruction as additional input features, we substantially improve over baselines that use kinematic features alone. We further demonstrate that a single linear layer trained using only the latent representations achieves competitive performance against state-of-the-art baseline architectures, and outperforms the baseline for missing momentum regression with approximately 35 times fewer parameters. These results demonstrate that the latent representations learned during reconstruction encode essential physics information needed for downstream analysis, establishing MLPF as a foundation model and offering a concrete step toward an end-to-end pipeline from detector data to physics analysis.
Farouk Mokhtar, Joosep Pata, Michael Kagan +1
University of California San Diego, La Jolla, California 92093, USA · National Institute of Chemical Physics and Biophysics, Tallinn 12618, Estonia · SLAC National Accelerator Laboratory, Menlo Park, California 94025, USA