cs.LGOct 2, 2026

Hyperparameter selection for equation learning with biologically-informed neural networks

Authors: William Lavery, Jodie A. Cochrane, John T. Nardini, Sara Hamis

Organizations: Department of Information Technology, Uppsala University, Sweden · Department of Mathematics and Statistics, The College of New Jersey, USA

Abstract

Biologically-informed neural networks (BINNs) have emerged as a flexible subclass of physics-informed neural networks (PINNs) for learning terms in partial differential equations from data. BINNs are particularly suited for biological systems, where the governing equations are highly nonlinear and only partially known a priori, and where data observations are often sparse, noisy, and incomplete. However, applying BINNs effectively in practice depends critically on hyperparameter selection, which remains a central challenge in equation-learning frameworks. Hyperparameters are often chosen heuristically and only cursorily documented, which limits the reproducibility of results and the transferability of methods. We present a diagnostic workflow for hyperparameter selection that can be used when the ground-truth equations are not known. The workflow is guided by three main questions: (1) Are the benefits of greater network capacity worth the cost? (2) Do more training epochs keep reducing the validation loss? (3) Do the learned terms stop changing as network capacity and training increase? We apply our workflow to synthetic systems of varying complexity with known ground truth, spanning diffusion and growth right-hand side terms and data ranging from 1D+t to 2D+t. We demonstrate that the validation loss generally follows the true error in the learned terms and distil practical rules of thumb for selecting hyperparameters in the BINN architecture. By providing a structured workflow, practical guidelines, and suggested starting values for hyperparameter selection, this work lowers the barrier to BINN-based equation learning.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Physics-Informed Neural Networks for Biological 2D+t2\mathrm{D}{+}t Reaction-Diffusion Systems

    Apr 20, 2026William Lavery, Jodie A. Cochrane, Christian Olesen +3Dynamical SystemsReaction-Diffusion Systems

  2. Reliable mechanistic operator recovery with biologically-informed neural networks: principles for architecture and optimisation design

    Jul 8, 2026Rebecca M. Crossley, Yuan Yin, Sarah L. Waters +1Neural Network OptimizationMechanistic Interpretability

  3. Deep Neural Networks as Discrete Dynamical Systems: Implications for Physics-Informed Learning

    Jan 1, 2026Abhisek Ganguly, Santosh Ansumali, Sauro SucciDynamical SystemsNeural PDE Solvers