Disentangled Representation Learning for Parametric Partial Differential Equations
Not on the map. Why?
Abstract (arXiv)
Neural operators (NOs) excel at learning mappings between function spaces, serving as efficient forward solution approximators for PDE-governed systems. However, as black-box solvers, they offer limited insight into the underlying physical mechanism, due to the lack of interpretable representations of the physical parameters that drive the system. To tackle this challenge, we propose a new paradigm for learning disentangled representations from NO parameters, thereby effectively solving an inverse problem. Specifically, we introduce DisentangO, a novel hyper-neural operator architecture designed to unveil and disentangle latent physical factors of variation embedded within the black-box neural operator parameters. At the core of DisentangO is a multi-task NO architecture that distills the varying parameters of the governing PDE through a task-wise adaptive layer, alongside a variational autoencoder that disentangles these variations into identifiable latent factors. By learning these disentangled representations, DisentangO not only enhances physical interpretability but also enables more robust generalization across diverse systems. Empirical evaluations across supervised, semi-supervised, and unsupervised learning contexts show that DisentangO effectively extracts meaningful and interpretable latent features, bridging the gap between predictive performance and physical understanding in neural operator frameworks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 52 of its 81 references that are in the map. First posted on arXiv 3 Oct 2024.
Builds on
52 of 81 references.
References · 52
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2016HyperNetworkscited by 1,003
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
- 2018Disentangling by Factorisingcited by 614
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
38 more
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2017Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanicscited by 213
- 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
- 2021Neural Symbolic Regression that Scalescited by 185
- 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
- 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
- 2023Neural Inverse Operators for Solving PDE Inverse Problemscited by 61
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
- 2019Unsupervised Model Selection for Variational Disentangled Representation Learningcited by 46
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
- 2019Physical Symmetries Embedded in Neural Networkscited by 40
- 2023Domain Agnostic Fourier Neural Operatorscited by 36
- 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
- 2018Regularization by architecture: A deep prior approach for inverse problemscited by 26
- 2023HyperDeepONet: learning operator with complex target function space using the limited resources via hypernetworkcited by 25
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2024Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discoverycited by 18
- 2022IAE-Net: Integral Autoencoders for Discretization-Invariant Learningcited by 15
- 2023Solving Inverse Physics Problems with Score Matchingcited by 15
- 2023Deciphering and integrating invariants for neural operator learning with various physical mechanismscited by 15
- 2023Partial Identifiability for Domain Adaptationcited by 14
- 2024Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturingcited by 14
- 2022CVAE-H: Conditionalizing Variational Autoencoders via Hypernetworks and Trajectory Forecasting for Autonomous Drivingcited by 13
- 2023Interpretable Meta-Learning of Physical Systemscited by 11
- 2023MetaNO: How to Transfer Your Knowledge on Learning Hidden Physicscited by 10
- 2021Disentangled Generative Models for Robust Prediction of System Dynamicscited by 8
- 2019Solving Traveltime Tomography with Deep Learningcited by 7
- 2020Deep synthesis regularization of inverse problemscited by 7
- 2023InVAErt networks: a data-driven framework for model synthesis and identifiability analysiscited by 6
- 2024FUSE: Fast Unified Simulation and Estimation for PDEscited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 2.
2 papers.