cs.LGJul 9, 2026

DeepPySR -- A Symbolic Regression Framework with Dynamic Pruning, Pareto Selection, and Hierarchical Composition for Real-World Scientific Discovery

Authors: Fuling ChenKevin VinsenPhillip MeltonRae-Chi Huang

Organizations: International Centre for Radio Astronomy Research (ICRAR), University of Western Australia, Perth, WA, Australia · The Raine Study, University of Western Australia, Perth, WA, Australia · Menzies Institute for Medical Research, University of Tasmania, Hobart, TAS, Australia · Nutrition & Health Innovation Research Institute, School of Medical and Health Sciences, Edith Cowan University, Perth, WA, Australia

Abstract

Symbolic regression (SR) discovers analytical equations from data, yielding glass-box models with directly interpretable formulas, unlike black-box methods that rely on unstable post-hoc tools such as SHAP or LIME. This transparency is crucial in clinical medicine and social science, but SR faces three challenges: high-dimensional inputs, principled selection of Pareto-front formulae, and data irregularities such as multicollinearity and class imbalance. We introduce DeepPySR, which addresses these issues with a dynamic variable-pruning schedule to remove irrelevant features during search, an exponential Pareto selection criterion that eliminates trade-offs between accuracy and complexity, and a multi-layer architecture for hierarchical symbolic composition. On four Feynman physics benchmarks and seven biomedical and social-science datasets, DeepPySR outperforms PySR and baselines on body fat (R2^2: 0.794 vs.\ 0.702), heart disease (F1: 0.898 vs.\ 0.787), student performance (R2^2: 0.964 vs.\ 0.948), and Raine BMI (R2^2: 0.525 vs.\ 0.370), producing interpretable formulas aligned with domain risk factors.

Explore similar work

CardsList