mlsanityData to 7 Oct 2026

SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks

arXiv 2407.07358 ↗First posted 10 Jul 2024cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

SGM-PINN is a graph-based importance sampling framework to improve the training efficacy of Physics-Informed Neural Networks (PINNs) on parameterized problems. By applying a graph decomposition scheme to an undirected Probabilistic Graphical Model (PGM) built from the training dataset, our method generates node clusters encoding conditional dependence between training samples. Biasing sampling towards more important clusters allows smaller mini-batches and training datasets, improving training speed and accuracy. We additionally fuse an efficient robustness metric with residual losses to determine regions requiring additional sampling. Experiments demonstrate the advantages of the proposed framework, achieving 3× faster convergence compared to prior state-of-the-art sampling methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 26 references that are in the map. First posted on arXiv 10 Jul 2024.

Builds on

12 of 26 references.

References · 12

  1. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  2. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  3. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  4. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  5. 2018Not All Samples Are Created Equal: Deep Learning with Importance Samplingcited by 323
  6. 2021Efficient training of physics-informed neural networks via importance samplingcited by 109
  7. 2022Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Samplingcited by 71
  8. 2017Biased Importance Sampling for Deep Neural Network Trainingcited by 31
  9. 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
  10. 2021SPADE: A Spectral Method for Black-Box Adversarial Robustness Evaluationcited by 16
  11. 2017Graph Clustering using Effective Resistancecited by 12
  12. 2022HyperEF: Spectral Hypergraph Coarsening by Effective-Resistance Clusteringcited by 6

Built on by

Not cited yet.