Resolving gradient pathology in physics-informed epidemiological models
Not on the map. Why?
Abstract (arXiv)
Physics-informed neural networks (PINNs) are increasingly used in mathematical epidemiology to bridge the gap between noisy clinical data and compartmental models, such as the susceptible-exposed-infected-removed (SEIR) model. However, training these hybrid networks is often unstable due to competing optimization objectives. As established in recent literature on ``gradient pathology," the gradient vectors derived from the data loss and the physical residual often point in conflicting directions, leading to slow convergence or optimization deadlock. While existing methods attempt to resolve this by balancing gradient magnitudes or projecting conflicting vectors, we propose a novel method, conflict-gated gradient scaling (CGGS), to address gradient conflicts in physics-informed neural networks for epidemiological modelling, ensuring stable and efficient training and a computationally efficient alternative. This method utilizes the cosine similarity between the data and physics gradients to dynamically modulate the penalty weight. Unlike standard annealing schemes that only normalize scales, CGGS acts as a geometric gate: it suppresses the physical constraint when directional conflict is high, allowing the optimizer to prioritize data fidelity, and restores the constraint when gradients align. We prove that this gating mechanism preserves the standard O(1/T) convergence rate for smooth non-convex objectives, a guarantee that fails under fixed-weight or magnitude-balanced training when gradients conflict. We demonstrate that this mechanism autonomously induces a curriculum learning effect, improving parameter estimation in stiff epidemiological systems compared to magnitude-based baselines. Our empirical results show improved peak recovery and convergence over magnitude-based methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 19 references that are in the map. First posted on arXiv 25 Mar 2026.
Builds on
8 of 19 references.
References · 8
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2013Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programmingcited by 716
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2018Adapting Auxiliary Losses Using Gradient Similaritycited by 98
- 2025Gradient Alignment in Physics-informed Neural Networks: A Second-Order Optimization Perspectivecited by 55
- 2024ConFIG: Towards Conflict-free Training of Physics Informed Neural Networkscited by 43
- 2025GCond: Gradient Conflict Resolution via Accumulation-based Stabilization for Large-Scale Multi-Task Learningcited by 2
Built on by
Not cited yet.