Physics-based Deep Learning
Not on the map. Why?
Abstract (arXiv)
This document is a hands-on, comprehensive guide to deep learning in the realm of physical simulations. Rather than just theory, we emphasize practical application: every concept is paired with interactive Jupyter notebooks to get you up and running quickly. Beyond traditional supervised learning, we dive into physical loss-constraints, differentiable simulations, diffusion-based approaches for probabilistic generative AI, as well as reinforcement learning and advanced neural network architectures. These foundations are paving the way for the next generation of scientific foundation models. We are living in an era of rapid transformation. These methods have the potential to redefine what's possible in computational science.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2021.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2021: 2; 2022: 17; 2023: 13; 2024: 15; 2025: 12; 2026: 8.
67 papers.
Sort:
By area:
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 65
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
- 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
- 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
38 more
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 25
- 2022EINNs: Epidemiologically-informed Neural Networkscited by 21
- 2022Experience report of physics-informed neural networks in fluid simulations: pitfalls and frustrationcited by 21
- 2023Solving Inverse Physics Problems with Score Matchingcited by 15
- 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equationscited by 15
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
- 2023A Multifidelity deep operator network approach to closure for multiscale systemscited by 11
- 2024Neural SPH: Improved Neural Modeling of Lagrangian Fluid Dynamicscited by 10
- 2024Metamizer: a versatile neural optimizer for fast and accurate physics simulationscited by 7
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamicscited by 7
- 2025GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulationscited by 7
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equationscited by 5
- 2022Selected Trends in Artificial Intelligence for Space Applicationscited by 5
- 2025Governing Equation Discovery from Data Based on Differential Invariantscited by 4
- 2023Inductive biases in deep learning models for weather predictioncited by 3
- 2023Extreme heatwave sampling and prediction with analog Markov chain and comparisons with deep learningcited by 3
- 2023Improved prediction of ligand-protein binding affinities by meta-modelingcited by 3
- 2024JAX-SPH: A Differentiable Smoothed Particle Hydrodynamics Frameworkcited by 3
- 2024Stabilizing Backpropagation Through Time to Learn Complex Physicscited by 3
- 2025PRDP: Progressively Refined Differentiable Physicscited by 3
- 2022DeepClouds.ai: Deep learning enabled computationally cheap direct numerical simulationscited by 2
- 2024Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solvingcited by 2
- 2024Combining Federated Learning and Control: A Surveycited by 2
- 2021Does Explainable Machine Learning Uncover the Black Box in Vision Applications?cited by 1
- 2022Learning Similarity Metrics for Volumetric Simulations with Multiscale CNNscited by 1
- 2022FO-PINNs: A First-Order formulation for Physics Informed Neural Networkscited by 1
- 2022Exploring Physical Latent Spaces for High-Resolution Flow Restorationcited by 1
- 2023Deep learning modelling of manufacturing and build variations on multi-stage axial compressors aerodynamicscited by 1
- 2024Modern, Efficient, and Differentiable Transport Equation Models using JAX: Applications to Population Balance Equationscited by 1
- 2025PhysicsGen: Can Generative Models Learn from Images to Predict Complex Physical Relations?cited by 1
- 2025Towards scientific machine learning for granular material simulations -- challenges and opportunitiescited by 1
- 2025Leveraging Analytic Gradients in Provably Safe Reinforcement Learningcited by 1
- 2025Differentiable Physics-Neural Models enable Learning of Non-Markovian Closures for Accelerated Coarse-Grained Physics Simulationscited by 1
- 2026Adjoint-based shape optimization of a ship hull using a Conditional Variational Autoencoder (CVAE) assisted propulsion surrogate modelcited by 1
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontiercited by 1
- 2022Differentiable Physics-based Greenhouse Simulationcited by 0
- 2022Differentiable optimization of the Debye-Wolf integral for light shaping and adaptive optics in two-photon microscopycited by 0
50 most cited of 67 All 67 (JSON)
- 2026Differentiable Hybrid Modelling for Learning and Optimising Chemical Transport Processes from Experimental Data3 Sep 2026
- 2026Generative Diffusion Surrogates with Analytical Variance Schedule1 Sep 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026SWIM: Compact Environment Representation for Reinforcement Learning Human Swimming29 May 2026
- 2026Learned Lagrangian Models of PDEs via Euler-Lagrange Residual Minimization8 May 2026
- 2026General Explicit Network (GEN): A novel deep learning architecture for solving partial differential equations2 Apr 2026
- 2026Adjoint-based shape optimization of a ship hull using a Conditional Variational Autoencoder (CVAE) assisted propulsion surrogate model16 Feb 2026
- 2026Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgery20 Jan 2026
- 2025Differentiable Physics-Neural Models enable Learning of Non-Markovian Closures for Accelerated Coarse-Grained Physics Simulations26 Nov 2025
- 2025Learning Biomolecular Motion: The Physics-Informed Machine Learning Paradigm10 Nov 2025
- 2025GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulations8 Oct 2025
- 2025Leveraging Analytic Gradients in Provably Safe Reinforcement Learning2 Jun 2025
38 more
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulations30 May 2025
- 2025Governing Equation Discovery from Data Based on Differential Invariants24 May 2025
- 2025Towards scientific machine learning for granular material simulations -- challenges and opportunities1 Apr 2025
- 2025Learning second-order TVD flux limiters using differentiable solvers11 Mar 2025
- 2025PhysicsGen: Can Generative Models Learn from Images to Predict Complex Physical Relations?7 Mar 2025
- 2025PRDP: Progressively Refined Differentiable Physics26 Feb 2025
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformers13 Feb 2025
- 2025Physics-Driven Learning for Inverse Problems in Quantum Chromodynamics9 Jan 2025
- 2024Finding the Underlying Viscoelastic Constitutive Equation via Universal Differential Equations and Differentiable Physics31 Dec 2024
- 2024Graph Spring Neural ODEs for Link Sign Prediction17 Dec 2024
- 2024Modern, Efficient, and Differentiable Transport Equation Models using JAX: Applications to Population Balance Equations1 Nov 2024
- 2024Metamizer: a versatile neural optimizer for fast and accurate physics simulations10 Oct 2024
- 2024End-to-End Reaction Field Energy Modeling via Deep Learning based Voxel-to-voxel Transform4 Oct 2024
- 2024Biomimetic Frontend for Differentiable Audio Processing13 Sep 2024
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling13 Sep 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equations9 Jul 2024
- 2024Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solving5 May 2024
- 2024Stabilizing Backpropagation Through Time to Learn Complex Physics3 May 2024
- 2024JAX-SPH: A Differentiable Smoothed Particle Hydrodynamics Framework7 Mar 2024
- 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equations19 Feb 2024
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operators19 Feb 2024
- 2024Neural SPH: Improved Neural Modeling of Lagrangian Fluid Dynamics9 Feb 2024
- 2023Deep learning modelling of manufacturing and build variations on multi-stage axial compressors aerodynamics6 Oct 2023
- 2023Improved prediction of ligand-protein binding affinities by meta-modeling5 Oct 2023
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation4 Sep 2023
- 2023Bayesian Reasoning for Physics Informed Neural Networks25 Aug 2023
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug 2023
- 2023Recurrent Neural Networks with more flexible memory: better predictions than rough volatility4 Aug 2023
- 2023On Physical Origins of Learning27 Jul 2023
- 2023Extreme heatwave sampling and prediction with analog Markov chain and comparisons with deep learning18 Jul 2023
- 2023Inductive biases in deep learning models for weather prediction6 Apr 2023
- 2023A differentiable programming framework for spin models4 Apr 2023
- 2023A Multifidelity deep operator network approach to closure for multiscale systems15 Mar 2023
- 2023Improving deep learning precipitation nowcasting by using prior knowledge27 Jan 2023
- 2023Solving Inverse Physics Problems with Score Matching24 Jan 2023
- 2022Selected Trends in Artificial Intelligence for Space Applications10 Dec 2022
- 2022Physics-guided Data Augmentation for Learning the Solution Operator of Linear Differential Equations8 Dec 2022
50 newest of 67 All 67 (JSON)
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 205
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulationcited by 65
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modelingcited by 36
- 2023Solving Inverse Physics Problems with Score Matchingcited by 15
- 2024Integrating Neural Operators with Diffusion Models Improves Spectral Representation in Turbulence Modeling13 Sep 2024
- 2023Benchmarking Autoregressive Conditional Diffusion Models for Turbulent Flow Simulation4 Sep 2023
- 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solvers10 Aug 2023
- 2023Solving Inverse Physics Problems with Score Matching24 Jan 2023
- 2022Clifford Neural Layers for PDE Modelingcited by 91
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 87
- 2022Lie Point Symmetry Data Augmentation for Neural PDE Solverscited by 76
- 2025AB-UPT: Scaling Neural CFD Surrogates for High-Fidelity Automotive Aerodynamics Simulations via Anchored-Branched Universal Physics Transformerscited by 49
- 2022Learned Turbulence Modelling with Differentiable Fluid Solvers: Physics-based Loss-functions and Optimisation Horizonscited by 39
- 2022A posteriori learning for quasi-geostrophic turbulence parametrizationcited by 36
- 2022Deep Learning Methods for Partial Differential Equations and Related Parameter Identification Problemscited by 34
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
- 2025PDE-Transformer: Efficient and Versatile Transformers for Physics Simulationscited by 29
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 25
- 2022EINNs: Epidemiologically-informed Neural Networkscited by 21
12 most cited of 63 All 63 (JSON)
- 2026Differentiable Hybrid Modelling for Learning and Optimising Chemical Transport Processes from Experimental Data3 Sep 2026
- 2026Generative Diffusion Surrogates with Analytical Variance Schedule1 Sep 2026
- 2026From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier8 Jul 2026
- 2026SWIM: Compact Environment Representation for Reinforcement Learning Human Swimming29 May 2026
- 2026Learned Lagrangian Models of PDEs via Euler-Lagrange Residual Minimization8 May 2026
- 2026General Explicit Network (GEN): A novel deep learning architecture for solving partial differential equations2 Apr 2026
- 2026Adjoint-based shape optimization of a ship hull using a Conditional Variational Autoencoder (CVAE) assisted propulsion surrogate model16 Feb 2026
- 2026Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgery20 Jan 2026
- 2025Differentiable Physics-Neural Models enable Learning of Non-Markovian Closures for Accelerated Coarse-Grained Physics Simulations26 Nov 2025
- 2025Learning Biomolecular Motion: The Physics-Informed Machine Learning Paradigm10 Nov 2025
- 2025GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulations8 Oct 2025
- 2025Leveraging Analytic Gradients in Provably Safe Reinforcement Learning2 Jun 2025
12 newest of 63 All 63 (JSON)