cs.LGAug 1, 2026

Verifier-Guided Model Discovery for Physical Dynamical Systems with Pretrained Symbolic Transformers

Authors: Farbod FarajiFrancesco Belardinelli

Organizations: Department of Computing, Huxley Building, Imperial College London 180 Queen’s Gate, South Kensington, London SW7 2RH, United Kingdom

Abstract

Reliable forecasting of nonlinear physical systems underpins scientific discovery and engineering decision-making. Yet high-fidelity simulations are prohibitively costly, and machine-learning surrogates can be opaque and encode assumptions about system dynamics, limiting generalizability. Pretrained transformers mapping synthetic ODE trajectories to equations offer interpretable alternatives, promising transfer without system-specific equation knowledge. Transferring them reliably to high-dimensional physical data, however, remains an open challenge. We develop a verifier-guided (VG) workflow around ODEFormer as a symbolic backbone, using dynamical and physical-admissibility criteria to select from a multi-trajectory candidate equation pool, enabling transfer. On canonical Van der Pol oscillators, VG outperforms the original ODEFormer workflow across held-out initial conditions. We then address vortex shedding, a phenomenon occurring in atmospheric and plasma systems of societal relevance, through coordinate reduction and symbolic discovery at fixed and varying Reynolds numbers. VG discovers fixed-parameter reduced-order equations that recover the fundamental shedding oscillator and higher harmonics without a wake-specific candidate library or prescribed Navier-Stokes structure, while the cross-parameter model generalizes to withheld regimes. Reconstruction fidelity alone did not determine symbolic discoverability, highlighting the importance of compatibility between latent dynamics and the backbone's pretraining distribution. This work establishes a verifier-guided neural-to-symbolic methodology for interpretable and physically auditable forecasting in the natural sciences.

Explore similar work

Jan 14, 2025cs.AI

A Neural Operator-Based Approach to Symbolic Discovery of PDEs

Discovering governing equations from data remains challenging when the underlying dynamics involve nonlocal differential operators, field interactions governed by auxiliary equations, or temporal memory effects. We propose Neural Operator-based symbolic Model approximaTion and discOvery (NOMTO), a framework that extends Equation Learner-type symbolic architectures by incorporating pretrained neural operators as nodes in the symbolic network. NOMTO represents candidate equations as sparse differentiable computational graphs that combine algebraic operations with fixed neural operator surrogates pretrained to approximate nonlinear operators. We evaluate the method on model-discovery problems involving nonlocal spatial operators, couplings mediated by auxiliary field equations, and temporal integral terms representing memory effects. The results show that NOMTO can recover compact governing equations containing nonlocal operator terms, thereby extending symbolic model discovery beyond libraries restricted to local derivatives and point-wise algebraic combinations.
Sergei Garmaev, Olga Fink
Apr 17, 2026cs.LG

Neuro-Symbolic ODE Discovery with Latent Grammar Flow

Understanding natural and engineered systems often relies on symbolic formulations, such as differential equations, which provide interpretability and transferability beyond black-box models. We introduce Latent Grammar Flow (LGF), a neuro-symbolic generative framework for discovering ordinary differential equations from data. LGF embeds equations as grammar-based representations into a discrete latent space and forces semantically similar equations to be positioned closer together with a behavioural loss. Then, a discrete flow model guides the sampling process to recursively generate candidate equations that best fit the observed data. Domain knowledge and constraints, such as stability, can be either embedded into the rules or used as conditional predictors.
Karin Yu, Eleni Chatzi, Georgios Kissas
May 8, 2026cs.AI

Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation

Discovering governing differential equations from observational data is a fundamental challenge in scientific machine learning. Existing symbolic regression approaches rely primarily on quantitative metrics; however, real-world differential equation modeling also requires incorporating domain knowledge to ensure physical plausibility. To address this gap, we propose DoLQ, a method for discovering ordinary differential equations with LLM-based qualitative and quantitative evaluation. DoLQ employs a multi-agent architecture: a Sampler Agent proposes dynamic system candidates, a Parameter Optimizer refines equations for accuracy, and a Scientist Agent leverages an LLM to conduct both qualitative and quantitative evaluations and synthesize their results to iteratively guide the search. Experiments on multi-dimensional ordinary differential equation benchmarks demonstrate that DoLQ achieves superior performance compared to existing methods, not only attaining higher success rates but also more accurately recovering the correct symbolic terms of ground truth equations. Our code is available at https://github.com/Bon99yun/DoLQ.
Sum Kyun Song, Bong Gyun Shin, Jae Yong Lee