mlsanityData to 7 Oct 2026

GradINN: Gradient Informed Neural Network

arXiv 2409.01914 ↗First posted 3 Sep 2024cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose Gradient Informed Neural Networks (GradINNs), a methodology inspired by Physics Informed Neural Networks (PINNs) that can be used to efficiently approximate a wide range of physical systems for which the underlying governing equations are completely unknown or cannot be defined, a condition that is often met in complex engineering problems. GradINNs leverage prior beliefs about a system's gradient to constrain the predicted function's gradient across all input dimensions. This is achieved using two neural networks: one modeling the target function and an auxiliary network expressing prior beliefs, e.g., smoothness. A customized loss function enables training the first network while enforcing gradient constraints derived from the auxiliary network. We demonstrate the advantages of GradINNs, particularly in low-data regimes, on diverse problems spanning non time-dependent systems (Friedman function, Stokes Flow) and time-dependent systems (Lotka-Volterra, Burger's equation). Experimental results showcase strong performance compared to standard neural networks and PINN-like approaches across all tested scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 27 references that are in the map. First posted on arXiv 3 Sep 2024.

Builds on

8 of 27 references.

References · 8

  1. 2015Automatic differentiation in machine learning: a surveycited by 846
  2. 2019Hamiltonian Neural Networkscited by 702
  3. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  4. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  5. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  6. 2017Sobolev Training for Neural Networkscited by 136
  7. 2020Hamiltonian neural networks for solving equations of motioncited by 33
  8. 2022Universal approximation property of invertible neural networkscited by 30

Built on by

Not cited yet.