mlsanityData to 7 Oct 2026

Learning Physical Models that Can Respect Conservation Laws

arXiv 2302.11002 ↗First posted 21 Feb 2023cs.LG cs.NA math.APcited by 58

Not on the map. Why?

Abstract (arXiv)

Recent work in scientific machine learning (SciML) has focused on incorporating partial differential equation (PDE) information into the learning process. Much of this work has focused on relatively "easy" PDE operators (e.g., elliptic and parabolic), with less emphasis on relatively "hard" PDE operators (e.g., hyperbolic). Within numerical PDEs, the latter problem class requires control of a type of volume element or conservation constraint, which is known to be challenging. Delivering on the promise of SciML requires seamlessly incorporating both types of problems into the learning process. To address this issue, we propose ProbConserv, a framework for incorporating conservation constraints into a generic SciML architecture. To do so, ProbConserv combines the integral form of a conservation law with a Bayesian update. We provide a detailed analysis of ProbConserv on learning with the Generalized Porous Medium Equation (GPME), a widely-applicable parameterized family of PDEs that illustrates the qualitative properties of both easier and harder PDEs. ProbConserv is effective for easy GPME variants, performing well with state-of-the-art competitors; and for harder GPME variants it outperforms other approaches that do not guarantee volume conservation. ProbConserv seamlessly enforces physical conservation constraints, maintains probabilistic uncertainty quantification (UQ), and deals well with shocks and heteroscedasticities. In each case, it achieves superior predictive performance on downstream tasks.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 21 of its 62 references that are in the map. First posted on arXiv 21 Feb 2023.

Builds on

21 of 62 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  4. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  6. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  7. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  8. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  9. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  10. 2019Attentive Neural Processescited by 280
  11. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  12. 2022Physics-Informed Deep Neural Operator Networkscited by 110
9 more
  1. 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
  2. 2020Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flowscited by 36
  3. 2022Learning differentiable solvers for systems with hard constraintscited by 34
  4. 2022Learning continuous models for continuous physicscited by 28
  5. 2022Adaptive Self-supervision Algorithms for Physics-informed Neural Networkscited by 24
  6. 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
  7. 2020ResNet After All? Neural ODEs and Their Numerical Solutioncited by 20
  8. 2022Exact conservation laws for neural network integrators of dynamical systemscited by 15
  9. 2022Using Conservation Laws to Infer Deep Learning Model Accuracy of Richtmyer-meshkov Instabilitiescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 20; 2025: 16; 2026: 17.

58 papers.

Sort:

By area:

  1. 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
  2. 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
  3. 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
  4. 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraintscited by 46
  5. 2024Gradient-Free Generation for Hard-Constrained Systemscited by 35
  6. 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
  7. 2025Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraintscited by 26
  8. 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
  9. 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
  10. 2023Renormalizing Diffusion Modelscited by 16
  11. 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 15
  12. 2024Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEscited by 14
38 more
  1. 2024AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamicscited by 13
  2. 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generationcited by 11
  3. 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
  4. 2025Neural equilibria for long-term prediction of nonlinear conservation lawscited by 10
  5. 2025End-to-End Probabilistic Framework for Learning with Hard Constraintscited by 8
  6. 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modelingcited by 7
  7. 2024Physics-informed Discretization-independent Deep Compositional Operator Networkcited by 6
  8. 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Samplingcited by 6
  9. 2023Gaussian process learning of nonlinear dynamicscited by 5
  10. 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
  11. 2024Machine Learning Visualization Tool for Exploring Parameterized Hydrodynamicscited by 4
  12. 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
  13. 2024Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularizationcited by 3
  14. 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3
  15. 2024Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Datacited by 3
  16. 2024RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Modelscited by 3
  17. 2025Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Modelscited by 3
  18. 2025Uncertainty-Aware Diagnostics for Physics-Informed Machine Learningcited by 3
  19. 2026Project and Generate: Divergence-Free Neural Operators for Incompressible Flowscited by 3
  20. 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equationscited by 2
  21. 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledgecited by 2
  22. 2024Coupled Integral PINN for Discontinuitycited by 1
  23. 2025Towards Robust Surrogate Models: Benchmarking Machine Learning Approaches to Expediting Phase Field Simulations of Brittle Fracturecited by 1
  24. 2025Physically consistent model learning for reaction-diffusion systemscited by 1
  25. 2026The Theory and Practice of MAP Inference over Non-Convex Constraintscited by 1
  26. 2026Learning with Embedded Linear Equality Constraints via Variational Bayesian Inferencecited by 1
  27. 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimizationcited by 1
  28. 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errorscited by 1
  29. 2026Enforcing Dirichlet Boundary Conditions in Operator Learningcited by 1
  30. 2023Time-vectorized numerical integration for systems of ODEscited by 0
  31. 2024A nudge to the truth: atom conservation as a hard constraint in models of atmospheric composition using an uncertainty-weighted correctioncited by 0
  32. 2024How to Re-enable PDE Loss for Physical Systems Modeling Under Partial Observationcited by 0
  33. 2025Learning and Transferring Physical Models through Derivativescited by 0
  34. 2025Interpretability and Generalization Bounds for Learning Spatial Physicscited by 0
  35. 2025Estimating Parameter Fields in Multi-Physics PDEs from Scarce Measurementscited by 0
  36. 2025HPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systemscited by 0
  37. 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulationscited by 0
  38. 2026FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstructioncited by 0

50 most cited of 58 All 58 (JSON)