Learning Physical Models that Can Respect Conservation Laws
Not on the map. Why?
Abstract (arXiv)
Recent work in scientific machine learning (SciML) has focused on incorporating partial differential equation (PDE) information into the learning process. Much of this work has focused on relatively "easy" PDE operators (e.g., elliptic and parabolic), with less emphasis on relatively "hard" PDE operators (e.g., hyperbolic). Within numerical PDEs, the latter problem class requires control of a type of volume element or conservation constraint, which is known to be challenging. Delivering on the promise of SciML requires seamlessly incorporating both types of problems into the learning process. To address this issue, we propose ProbConserv, a framework for incorporating conservation constraints into a generic SciML architecture. To do so, ProbConserv combines the integral form of a conservation law with a Bayesian update. We provide a detailed analysis of ProbConserv on learning with the Generalized Porous Medium Equation (GPME), a widely-applicable parameterized family of PDEs that illustrates the qualitative properties of both easier and harder PDEs. ProbConserv is effective for easy GPME variants, performing well with state-of-the-art competitors; and for harder GPME variants it outperforms other approaches that do not guarantee volume conservation. ProbConserv seamlessly enforces physical conservation constraints, maintains probabilistic uncertainty quantification (UQ), and deals well with shocks and heteroscedasticities. In each case, it achieves superior predictive performance on downstream tasks.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 21 of its 62 references that are in the map. First posted on arXiv 21 Feb 2023.
Builds on
21 of 62 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2019Attentive Neural Processescited by 280
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
9 more
- 2022Neural Conservation Laws: A Divergence-Free Perspectivecited by 67
- 2020Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flowscited by 36
- 2022Learning differentiable solvers for systems with hard constraintscited by 34
- 2022Learning continuous models for continuous physicscited by 28
- 2022Adaptive Self-supervision Algorithms for Physics-informed Neural Networkscited by 24
- 2022Guiding continuous operator learning through Physics-based boundary constraintscited by 21
- 2020ResNet After All? Neural ODEs and Their Numerical Solutioncited by 20
- 2022Exact conservation laws for neural network integrators of dynamical systemscited by 15
- 2022Using Conservation Laws to Infer Deep Learning Model Accuracy of Richtmyer-meshkov Instabilitiescited by 3
Built on by
Citing papers per year: 2023: 5; 2024: 20; 2025: 16; 2026: 17.
58 papers.
Sort:
By area:
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraintscited by 46
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 35
- 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
- 2025Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraintscited by 26
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
- 2023Renormalizing Diffusion Modelscited by 16
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 15
- 2024Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEscited by 14
38 more
- 2024AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamicscited by 13
- 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generationcited by 11
- 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
- 2025Neural equilibria for long-term prediction of nonlinear conservation lawscited by 10
- 2025End-to-End Probabilistic Framework for Learning with Hard Constraintscited by 8
- 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modelingcited by 7
- 2024Physics-informed Discretization-independent Deep Compositional Operator Networkcited by 6
- 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Samplingcited by 6
- 2023Gaussian process learning of nonlinear dynamicscited by 5
- 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
- 2024Machine Learning Visualization Tool for Exploring Parameterized Hydrodynamicscited by 4
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
- 2024Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularizationcited by 3
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metricscited by 3
- 2024Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Datacited by 3
- 2024RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Modelscited by 3
- 2025Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Modelscited by 3
- 2025Uncertainty-Aware Diagnostics for Physics-Informed Machine Learningcited by 3
- 2026Project and Generate: Divergence-Free Neural Operators for Incompressible Flowscited by 3
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equationscited by 2
- 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledgecited by 2
- 2024Coupled Integral PINN for Discontinuitycited by 1
- 2025Towards Robust Surrogate Models: Benchmarking Machine Learning Approaches to Expediting Phase Field Simulations of Brittle Fracturecited by 1
- 2025Physically consistent model learning for reaction-diffusion systemscited by 1
- 2026The Theory and Practice of MAP Inference over Non-Convex Constraintscited by 1
- 2026Learning with Embedded Linear Equality Constraints via Variational Bayesian Inferencecited by 1
- 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimizationcited by 1
- 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errorscited by 1
- 2026Enforcing Dirichlet Boundary Conditions in Operator Learningcited by 1
- 2023Time-vectorized numerical integration for systems of ODEscited by 0
- 2024A nudge to the truth: atom conservation as a hard constraint in models of atmospheric composition using an uncertainty-weighted correctioncited by 0
- 2024How to Re-enable PDE Loss for Physical Systems Modeling Under Partial Observationcited by 0
- 2025Learning and Transferring Physical Models through Derivativescited by 0
- 2025Interpretability and Generalization Bounds for Learning Spatial Physicscited by 0
- 2025Estimating Parameter Fields in Multi-Physics PDEs from Scarce Measurementscited by 0
- 2025HPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systemscited by 0
- 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulationscited by 0
- 2026FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstructioncited by 0
50 most cited of 58 All 58 (JSON)
- 2026PMosFM: Preconditioned Manifold Matching for One-Step Physics-Constrained Generation30 Sep 2026
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026Evaluating Dynamical Fidelity through Predictive Structure in Physical Representations28 Sep 2026
- 2026Source Anchoring for Physical Consistency in Flow Matching Models27 Sep 2026
- 2026Enforcing Dirichlet Boundary Conditions in Operator Learning27 Aug 2026
- 2026On the post-hoc Evaluation of PDE Discovery: A Multifaceted Challenge of Scientific Advancement26 Jul 2026
- 2026A unified perspective of Gaussian process approximation for differential equations7 Jul 2026
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modelling19 Jun 2026
- 2026GENERIC-FNO: Embedding Energy Conservation and Entropy Production into Fourier Neural Operators6 Jun 2026
- 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errors4 Jun 2026
- 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization27 May 2026
- 2026Learning with Embedded Linear Equality Constraints via Variational Bayesian Inference27 Apr 2026
38 more
- 2026Project and Generate: Divergence-Free Neural Operators for Incompressible Flows25 Mar 2026
- 2026FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction22 Mar 2026
- 2026Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics Knowledge16 Feb 2026
- 2026The Theory and Practice of MAP Inference over Non-Convex Constraints9 Feb 2026
- 2026Deterministic and probabilistic neural surrogates of global hybrid-Vlasov simulations18 Jan 2026
- 2025Physically consistent model learning for reaction-diffusion systems16 Dec 2025
- 2025Uncertainty-Aware Diagnostics for Physics-Informed Machine Learning30 Oct 2025
- 2025HPC-Driven Modeling with ML-Based Surrogates for Magnon-Photon Dynamics in Hybrid Quantum Systems25 Oct 2025
- 2025Estimating Parameter Fields in Multi-Physics PDEs from Scarce Measurements29 Aug 2025
- 2025Towards Robust Surrogate Models: Benchmarking Machine Learning Approaches to Expediting Phase Field Simulations of Brittle Fracture9 Jul 2025
- 2025Interpretability and Generalization Bounds for Learning Spatial Physics18 Jun 2025
- 2025Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraints10 Jun 2025
- 2025End-to-End Probabilistic Framework for Learning with Hard Constraints8 Jun 2025
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints4 Jun 2025
- 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation28 May 2025
- 2025Strictly Constrained Generative Modeling via Split Augmented Langevin Sampling23 May 2025
- 2025Learning and Transferring Physical Models through Derivatives2 May 2025
- 2025Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Models24 Mar 2025
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting26 Feb 2025
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformers13 Feb 2025
- 2025Neural equilibria for long-term prediction of nonlinear conservation laws12 Jan 2025
- 2024How to Re-enable PDE Loss for Physical Systems Modeling Under Partial Observation12 Dec 2024
- 2024Gradient-Free Generation for Hard-Constrained Systems2 Dec 2024
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning30 Nov 2024
- 2024Gaussian Process Priors for Boundary Value Problems of Linear Partial Differential Equations25 Nov 2024
- 2024Coupled Integral PINN for Discontinuity18 Nov 2024
- 2024RAIN: Reinforcement Algorithms for Improving Numerical Weather and Climate Models28 Aug 2024
- 2024A nudge to the truth: atom conservation as a hard constraint in models of atmospheric composition using an uncertainty-weighted correction28 Aug 2024
- 2024AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamics30 Jul 2024
- 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modeling21 Jul 2024
- 2024Machine Learning Visualization Tool for Exploring Parameterized Hydrodynamics20 Jun 2024
- 2024Constrained or Unconstrained? Neural-Network-Based Equation Discovery from Data30 May 2024
- 2024BeamVQ: Aligning Space-Time Forecasting Model via Self-training on Physics-aware Metrics27 May 2024
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theory26 May 2024
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariance25 May 2024
- 2024Physics-informed Discretization-independent Deep Compositional Operator Network21 Apr 2024
- 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformations28 Mar 2024
- 2024Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEs15 Mar 2024
50 newest of 58 All 58 (JSON)
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Modelscited by 96
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraintscited by 46
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 35
- 2025Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraintscited by 26
- 2023Renormalizing Diffusion Modelscited by 16
- 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generationcited by 11
- 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errorscited by 1
- 2026Source Anchoring for Physical Consistency in Flow Matching Modelscited by 0
- 2026Source Anchoring for Physical Consistency in Flow Matching Models27 Sep 2026
- 2026Diffusion Models Observe Only Gradients: A Geometric Perspective on Score Matching Errors4 Jun 2026
- 2025Physics vs Distributions: Pareto Optimal Flow Matching with Physics Constraints10 Jun 2025
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints4 Jun 2025
- 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation28 May 2025
- 2024Gradient-Free Generation for Hard-Constrained Systems2 Dec 2024
- 2023Renormalizing Diffusion Models23 Aug 2023
- 2023PreDiff: Precipitation Nowcasting with Latent Diffusion Models19 Jul 2023
- 2024The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learningcited by 134
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
- 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
- 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
- 2024Graph Neural PDE Solvers with Conservation and Similarity-Equivariancecited by 15
- 2024Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEscited by 14
- 2024AhmedML: High-Fidelity Computational Fluid Dynamics Dataset for Incompressible, Low-Speed Bluff Body Aerodynamicscited by 13
- 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
- 2025Neural equilibria for long-term prediction of nonlinear conservation lawscited by 10
- 2025End-to-End Probabilistic Framework for Learning with Hard Constraintscited by 8
- 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modelingcited by 7
12 most cited of 50 All 50 (JSON)
- 2026PMosFM: Preconditioned Manifold Matching for One-Step Physics-Constrained Generation30 Sep 2026
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026Evaluating Dynamical Fidelity through Predictive Structure in Physical Representations28 Sep 2026
- 2026Enforcing Dirichlet Boundary Conditions in Operator Learning27 Aug 2026
- 2026On the post-hoc Evaluation of PDE Discovery: A Multifaceted Challenge of Scientific Advancement26 Jul 2026
- 2026A unified perspective of Gaussian process approximation for differential equations7 Jul 2026
- 2026Embedding Linear Equality Constraints in Probabilistic Neural Networks for Dynamic Modelling19 Jun 2026
- 2026GENERIC-FNO: Embedding Energy Conservation and Entropy Production into Fourier Neural Operators6 Jun 2026
- 2026Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization27 May 2026
- 2026Learning with Embedded Linear Equality Constraints via Variational Bayesian Inference27 Apr 2026
- 2026Project and Generate: Divergence-Free Neural Operators for Incompressible Flows25 Mar 2026
- 2026FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction22 Mar 2026
12 newest of 50 All 50 (JSON)