Multi-dimensional training-priority weighting based on physical information propagation paths: a unified residual-weighting framework for physics-informed neural networks
Not on the map. Why?
Abstract (arXiv)
Physics-informed neural networks (PINNs) have shown promise for solving partial differential equations (PDEs); however, their synchronous optimization treats residuals of different regions and constraints equally, which is inconsistent with the progressive "from source to response" physical information propagation path, degrading training stability and accuracy. Existing causal training methods focus mainly on the temporal dimension, lacking a unified characterization of spatial and boundary dimensions. To address this, we define a unified class of training priorities according to the physical information propagation path: premise regions should be learned before dependent regions; temporal, spatial, and boundary priorities are instances of this principle. Using neural tangent kernel (NTK) dynamics, we theoretically analyze why standard PINNs do not obey this priority: their residual convergence order is governed by the NTK spectrum and is independent of the propagation path. Accordingly, we propose a unified multi-dimensional priority-constraint framework that partitions the domain along the propagation path and constructs negative-exponential residual weights, converting the physical propagation order into a training priority. For cases with coexisting priorities, we introduce a directional compatibility coefficient to clarify that "orthogonal directions can be coupled multiplicatively in synergy, whereas coaxial opposite directions cannot." Benchmark cases show that this method consistently improves the convergence behavior and prediction accuracy of PINNs on problems with clear propagation paths or constraint-dominated structures, without modifying the network architecture and with controllable additional computational cost.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 48 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
22 of 48 references.
References · 22
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2022A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networkscited by 233
- 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
- 2021Finite Basis Physics-Informed Neural Networks (FBPINNs): a scalable domain decomposition approach for solving differential equationscited by 142
- 2021Exact imposition of boundary conditions with distance functions in physics-informed deep neural networkscited by 135
10 more
- 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
- 2021Multi-Objective Loss Balancing for Physics-Informed Deep Learningcited by 86
- 2023Residual-based attention in physics-informed neural networkscited by 72
- 2022Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) Samplingcited by 71
- 2021DAS-PINNs: A deep adaptive sampling method for solving high-dimensional partial differential equationscited by 66
- 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 62
- 2021Quadratic Residual Networks: A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEscited by 42
- 2023Physics-Informed Neural Networks for Time-Domain Simulations: Accuracy, Computational Cost, and Flexibilitycited by 13
- 2025Self-adaptive weighting and sampling for physics-informed neural networkscited by 6
- 2025Boundary condition enforcement with PINNs: a comparative study and verification on 3D geometriescited by 1
Built on by
Not cited yet.