Compositional Meta-Learning for Mitigating Task Heterogeneity in Physics-Informed Neural Networks
Not on the map. Why?
Abstract (arXiv)
Physics-informed neural networks (PINNs) approximate solutions of partial differential equations (PDEs) by embedding physical laws into the loss function. In parameterized PDE families, variations in coefficients or boundary/initial conditions define distinct tasks. This makes training individual PINNs for each task computationally prohibitive, while cross-task transfer can be sensitive to task heterogeneity. While meta-learning can reduce retraining cost, existing methods often rely on a single global initialization and may suffer from negative transfer, particularly under feature-scarce coordinate inputs and limited training-task availability. We propose the Learning-Affinity Adaptive Modular Physics-Informed Neural Network (LAM-PINN), a compositional framework that leverages task-specific learning dynamics. LAM-PINN combines PDE parameters with learning-affinity metrics from brief transfer sessions to construct a task representation and cluster tasks even with coordinate-only inputs. It decomposes the model into cluster-specialized subnetworks and a shared meta network, and learns routing weights to selectively reuse modules instead of relying on a single global initialization. Across three PDE benchmarks, LAM-PINN achieves an average 19.7-fold reduction in mean squared error (MSE) on unseen tasks using only 10% of the training iterations required by conventional PINNs. These results indicate its effectiveness for generalization to unseen configurations within bounded design spaces of parameterized PDE families in resource-constrained engineering settings.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 29 Apr 2026.
Builds on
27 of 39 references.
References · 27
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2014How transferable are features in deep neural networks?cited by 1,225
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2014On the Number of Linear Regions of Deep Neural Networkscited by 381
- 2018Bayesian Model-Agnostic Meta-Learningcited by 194
- 2019Fast and Flexible Multi-Task Classification Using Conditional Neural Adaptive Processescited by 131
- 2019Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulationcited by 103
- 2020Transfer learning based multi-fidelity physics informed deep neural networkcited by 68
- 2021One-Shot Transfer Learning of Physics-Informed Neural Networkscited by 49
- 2023Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networkscited by 44
15 more
- 2024Parameterized Physics-informed Neural Networks for Parameterized PDEscited by 38
- 2021Meta-Auto-Decoder for Solving Parametric Partial Differential Equationscited by 36
- 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
- 2021Task-adaptive Neural Process for User Cold-Start Recommendationcited by 32
- 2020Gradients as Features for Deep Representation Learningcited by 30
- 2020On Negative Interference in Multilingual Models: Findings and A Meta-Learning Treatmentcited by 21
- 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
- 2020A Survey on Machine Learning from Few Samplescited by 14
- 2023Hacking Task Confounder in Meta-Learningcited by 8
- 2021Neural Knitworks: Patched Neural Implicit Representation Networkscited by 7
- 2022PAC-Net: A Model Pruning Approach to Inductive Transfer Learningcited by 6
- 2023Meta-learning of Physics-informed Neural Networks for Efficiently Solving Newly Given PDEscited by 5
- 2023NODE-ImgNet: a PDE-informed effective and robust model for image denoisingcited by 3
- 2024Learning to Learn with Contrastive Meta-Objectivecited by 3
- 2025Compositional meta-learning through probabilistic task inferencecited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.