mlsanityData to 7 Oct 2026

Disentangled Representation Learning for Parametric Partial Differential Equations

arXiv 2410.02136 ↗First posted 3 Oct 2024cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Neural operators (NOs) excel at learning mappings between function spaces, serving as efficient forward solution approximators for PDE-governed systems. However, as black-box solvers, they offer limited insight into the underlying physical mechanism, due to the lack of interpretable representations of the physical parameters that drive the system. To tackle this challenge, we propose a new paradigm for learning disentangled representations from NO parameters, thereby effectively solving an inverse problem. Specifically, we introduce DisentangO, a novel hyper-neural operator architecture designed to unveil and disentangle latent physical factors of variation embedded within the black-box neural operator parameters. At the core of DisentangO is a multi-task NO architecture that distills the varying parameters of the governing PDE through a task-wise adaptive layer, alongside a variational autoencoder that disentangles these variations into identifiable latent factors. By learning these disentangled representations, DisentangO not only enhances physical interpretability but also enables more robust generalization across diverse systems. Empirical evaluations across supervised, semi-supervised, and unsupervised learning contexts show that DisentangO effectively extracts meaningful and interpretable latent features, bridging the gap between predictive performance and physical understanding in neural operator frameworks.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 52 of its 81 references that are in the map. First posted on arXiv 3 Oct 2024.

Builds on

52 of 81 references.

References · 52

  1. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  2. 2016Group Equivariant Convolutional Networkscited by 1,154
  3. 2016HyperNetworkscited by 1,003
  4. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  5. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  6. 2020NVAE: A Deep Hierarchical Variational Autoencodercited by 635
  7. 2018Disentangling by Factorisingcited by 614
  8. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  9. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
  10. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  11. 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
  12. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
38 more
  1. 2021Choose a Transformer: Fourier or Galerkincited by 333
  2. 2020B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Datacited by 329
  3. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
  4. 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
  5. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  6. 2017Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanicscited by 213
  7. 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
  8. 2021Neural Symbolic Regression that Scalescited by 185
  9. 2023A Brief Review of Hypernetworks in Deep Learningcited by 102
  10. 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
  11. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  12. 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
  13. 2023Neural Inverse Operators for Solving PDE Inverse Problemscited by 61
  14. 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
  15. 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
  16. 2019Unsupervised Model Selection for Variational Disentangled Representation Learningcited by 46
  17. 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
  18. 2019Physical Symmetries Embedded in Neural Networkscited by 40
  19. 2023Domain Agnostic Fourier Neural Operatorscited by 36
  20. 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
  21. 2018Regularization by architecture: A deep prior approach for inverse problemscited by 26
  22. 2023HyperDeepONet: learning operator with complex target function space using the limited resources via hypernetworkcited by 25
  23. 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
  24. 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
  25. 2024Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discoverycited by 18
  26. 2022IAE-Net: Integral Autoencoders for Discretization-Invariant Learningcited by 15
  27. 2023Solving Inverse Physics Problems with Score Matchingcited by 15
  28. 2023Deciphering and integrating invariants for neural operator learning with various physical mechanismscited by 15
  29. 2023Partial Identifiability for Domain Adaptationcited by 14
  30. 2024Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturingcited by 14
  31. 2022CVAE-H: Conditionalizing Variational Autoencoders via Hypernetworks and Trajectory Forecasting for Autonomous Drivingcited by 13
  32. 2023Interpretable Meta-Learning of Physical Systemscited by 11
  33. 2023MetaNO: How to Transfer Your Knowledge on Learning Hidden Physicscited by 10
  34. 2021Disentangled Generative Models for Robust Prediction of System Dynamicscited by 8
  35. 2019Solving Traveltime Tomography with Deep Learningcited by 7
  36. 2020Deep synthesis regularization of inverse problemscited by 7
  37. 2023InVAErt networks: a data-driven framework for model synthesis and identifiability analysiscited by 6
  38. 2024FUSE: Fast Unified Simulation and Estimation for PDEscited by 6

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.