mlsanityData to 14 Oct 2026

Hyperparameter selection for equation learning with biologically-informed neural networks

arXiv 2610.02954 ↗First posted 2 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Biologically-informed neural networks (BINNs) have emerged as a flexible subclass of physics-informed neural networks (PINNs) for learning terms in partial differential equations from data. BINNs are particularly suited for biological systems, where the governing equations are highly nonlinear and only partially known a priori, and where data observations are often sparse, noisy, and incomplete. However, applying BINNs effectively in practice depends critically on hyperparameter selection, which remains a central challenge in equation-learning frameworks. Hyperparameters are often chosen heuristically and only cursorily documented, which limits the reproducibility of results and the transferability of methods. We present a diagnostic workflow for hyperparameter selection that can be used when the ground-truth equations are not known. The workflow is guided by three main questions: (1) Are the benefits of greater network capacity worth the cost? (2) Do more training epochs keep reducing the validation loss? (3) Do the learned terms stop changing as network capacity and training increase? We apply our workflow to synthetic systems of varying complexity with known ground truth, spanning diffusion and growth right-hand side terms and data ranging from 1D+t to 2D+t. We demonstrate that the validation loss generally follows the true error in the learned terms and distil practical rules of thumb for selecting hyperparameters in the BINN architecture. By providing a structured workflow, practical guidelines, and suggested starting values for hyperparameter selection, this work lowers the barrier to BINN-based equation learning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 38 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

16 of 38 references.

References · 16

  1. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  2. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
  3. 2016Benefits of depth in neural networkscited by 250
  4. 2015The Power of Depth for Feedforward Neural Networkscited by 183
  5. 2023Discovering Causal Relations and Equations from Datacited by 36
  6. 2021Data vs. Physics: The Apparent Pareto Front of Physics-Informed Neural Networkscited by 27
  7. 2022Hyper-parameter tuning of physics-informed neural networks: Application to Helmholtz problemscited by 19
  8. 2022Auto-PINN: Understanding and Optimizing Physics-Informed Neural Architecturecited by 14
  9. 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 11
  10. 2022Physical Activation Functions (PAFs): An Approach for More Efficient Induction of Physics into Physics-Informed Neural Networks (PINNs)cited by 10
  11. 2024Discovering Physics-Informed Neural Networks Model for Solving Partial Differential Equations through Evolutionary Computationcited by 5
  12. 2024Non-Negative Universal Differential Equations With Applications in Systems Biologycited by 5
4 more
  1. 2025PINNverse: Accurate parameter estimation in differential equations from noisy data with constrained physics-informed neural networkscited by 4
  2. 2024Automated machine learning for physics-informed convolutional neural networkscited by 3
  3. 2026Physics-Informed Neural Networks for Biological 2D+t Reaction-Diffusion Systemscited by 2
  4. 2026Reliable mechanistic operator recovery with biologically-informed neural networks: principles for architecture and optimisation designcited by 1

Built on by

Not cited yet.