mlsanityData to 7 Oct 2026

From Simple to Complex: Curriculum-Guided Physics-Informed Neural Networks via Gaussian Mixture Models

arXiv 2605.19263 ↗First posted 19 May 2026cs.LG cs.NA math.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

Physics-informed neural networks (PINNs) offer a mesh-free framework for solving partial differential equations (PDEs), yet training often suffers from gradient pathologies, spectral bias, and poor convergence, especially for problems with strong nonlinearity, sharp gradients, or multiscale features. We propose the Curriculum-Guided Gaussian Mixture Physics-Informed Neural Network (CGMPINN), which integrates Gaussian mixture modeling with dynamic curriculum learning. Specifically, a GMM is periodically fitted to the PDE residual distribution to quantify spatially varying learning difficulty. A smooth curriculum schedule progressively shifts training focus from easy to harder regions, while precision-based variance modulation suppresses unreliable clusters during early optimization. This dual curriculum is governed by a shared curriculum parameter and can be combined with self-adaptive loss balancing. We further establish theoretical guarantees, including sublinear convergence of the gradient norm for the induced time-varying loss, uniform equivalence between the curriculum-weighted and standard PDE losses, and a generalization bound with an explicit weighting-induced bias characterization. Experiments on six benchmark PDEs spanning elliptic, parabolic, hyperbolic, advection-dominated, and nonlinear reaction-diffusion types show that CGMPINN consistently achieves the lowest relative L2 and maximum absolute errors among all compared methods, reducing relative L2 error by up to 97.8% over the standard PINN at comparable cost. Our code is publicly available at https://github.com/Mathematics-Yang/CGMPINN.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 41 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

17 of 41 references.

References · 17

  1. 2018On the Spectral Bias of Neural Networkscited by 1,321
  2. 2015Automatic differentiation in machine learning: a surveycited by 846
  3. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  4. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  5. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  6. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  7. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  8. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  9. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
  10. 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
  11. 2021Gradient-enhanced physics-informed neural networks for forward and inverse PDE problemscited by 220
  12. 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 144
5 more
  1. 2018Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 120
  2. 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
  3. 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
  4. 2022Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Samplingcited by 71
  5. 2025LNN-PINN: A Unified Physics-Only Training Framework with Liquid Residual Blockscited by 3

Built on by

Not cited yet.