mlsanityData to 7 Oct 2026

Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications

arXiv 2211.08064 ↗First posted 15 Nov 2022cs.LG cs.AI cs.CVcited by 88

Not on the map. Why?

Abstract (arXiv)

Recent advances of data-driven machine learning have revolutionized fields like computer vision, reinforcement learning, and many scientific and engineering domains. In many real-world and scientific problems, systems that generate data are governed by physical laws. Recent work shows that it provides potential benefits for machine learning models by incorporating the physical prior and collected data, which makes the intersection of machine learning and physics become a prevailing paradigm. By integrating the data and mathematical physics models seamlessly, it can guide the machine learning model towards solutions that are physically plausible, improving accuracy and efficiency even in uncertain and high-dimensional contexts. In this survey, we present this learning paradigm called Physics-Informed Machine Learning (PIML) which is to build a model that leverages empirical data and available physical prior knowledge to improve performance on a set of tasks that involve a physical mechanism. We systematically review the recent development of physics-informed machine learning from three perspectives of machine learning tasks, representation of physical prior, and methods for incorporating physical prior. We also propose several important open research problems based on the current trends in the field. We argue that encoding different forms of physical prior into model architectures, optimizers, inference algorithms, and significant domain-specific applications like inverse engineering design and robotic control is far from being fully explored in the field of physics-informed machine learning. We believe that the interdisciplinary research of physics-informed machine learning will significantly propel research progress, foster the creation of more effective machine learning models, and also offer invaluable assistance in addressing long-standing problems in related disciplines.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Builds on 210 of its 348 references that are in the map. First posted on arXiv 15 Nov 2022.

Builds on

210 of 348 references.

References · 210

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2020Language Models are Few-Shot Learnerscited by 32,199
  6. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  7. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  8. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  9. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  10. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  11. 2022Generative Adversarial Networkscited by 5,603
  12. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
38 more
  1. 2013Auto-Encoding Variational Bayescited by 3,980
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  5. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  6. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  8. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  9. 2016Density estimation using Real NVPcited by 2,029
  10. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  11. 2016Group Equivariant Convolutional Networkscited by 1,154
  12. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  13. 2019When Does Label Smoothing Help?cited by 985
  14. 2021E(n) Equivariant Graph Neural Networkscited by 951
  15. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  16. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  17. 2017A Survey on Multi-Task Learningcited by 838
  18. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  19. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  20. 2019Hamiltonian Neural Networkscited by 702
  21. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  22. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 666
  23. 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 647
  24. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  25. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  26. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  27. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  28. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 569
  29. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  30. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  31. 2015An Introduction to Convolutional Neural Networkscited by 510
  32. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  33. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  34. 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 449
  35. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  36. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
  37. 2020Lagrangian Neural Networkscited by 388
  38. 2022Message Passing Neural PDE Solverscited by 368

50 most cited of 210 All 210 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 20; 2024: 29; 2025: 29; 2026: 10.

88 papers.

Sort:

By area:

  1. 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
  2. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  3. 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 84
  4. 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 77
  5. 2023A unified scalable framework for causal sweeping strategies for Physics-Informed Neural Networks (PINNs) and their temporal decompositionscited by 48
  6. 2025What Has a Foundation Model Found? Using Inductive Bias to Probe for World Modelscited by 46
  7. 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
  8. 2025Generative Latent Neural PDE Solver using Flow Matchingcited by 28
  9. 2024RoPINN: Region Optimized Physics-Informed Neural Networkscited by 26
  10. 2023A Survey on Physics Informed Reinforcement Learning: Review and Open Problemscited by 22
  11. 2023Deep Learning in Deterministic Computational Mechanicscited by 21
  12. 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
38 more
  1. 2023MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural Networkscited by 17
  2. 2023NUNO: A General Framework for Learning Parametric PDEs with Non-Uniform Datacited by 15
  3. 2024Accelerating PDE Data Generation via Differential Operator Action in Solution Spacecited by 15
  4. 2024Accelerating Data Generation for Neural Operators via Krylov Subspace Recyclingcited by 12
  5. 2024Preconditioning for Physics-Informed Neural Networkscited by 12
  6. 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 11
  7. 2024FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representationcited by 10
  8. 2025Evolutionary Optimization of Physics-Informed Neural Networks: Evo-PINN Frontiers and Opportunitiescited by 10
  9. 2024PIETRA: Physics-Informed Evidential Learning for Traversing Out-of-Distribution Terraincited by 7
  10. 2025Inverse Design in Nanophotonics via Representation Learningcited by 7
  11. 2023NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theorycited by 6
  12. 2024Physics-Encoded Graph Neural Networks for Deformation Prediction under Contactcited by 6
  13. 2025ProPINN: Demystifying Propagation Failures in Physics-Informed Neural Networkscited by 6
  14. 2024Deep adaptive sampling for surrogate modeling without labeled datacited by 5
  15. 2024PINNs for Medical Image Analysis: A Surveycited by 5
  16. 2023DAC-MR: Data Augmentation Consistency Based Meta-Regularization for Meta-Learningcited by 4
  17. 2023The Hard-Constraint PINNs for Interface Optimal Control Problemscited by 4
  18. 2023CoDBench: A Critical Evaluation of Data-driven Models for Continuous Dynamical Systemscited by 4
  19. 2024When Geoscience Meets Generative AI and Large Language Models: Foundations, Trends, and Future Challengescited by 4
  20. 2024Sobolev Training for Operator Learningcited by 4
  21. 2024PAPM: A Physics-aware Proxy Model for Process Systemscited by 4
  22. 2024Domain-decoupled Physics-informed Neural Networks with Closed-form Gradients for Fast Model Learning of Dynamical Systemscited by 4
  23. 2024Physics-Informed Neural Networks with Trust-Region Sequential Quadratic Programmingcited by 4
  24. 2025Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigationcited by 4
  25. 2025Position: Biology is the Challenge Physics-Informed ML Needs to Evolvecited by 4
  26. 2024Fourier Controller Networks for Real-Time Decision-Making in Embodied Learningcited by 3
  27. 2025Adaptive Model-Predictive Control of a Soft Continuum Robot Using a Physics-Informed Neural Network Based on Cosserat Rod Theorycited by 3
  28. 2025Deep Neural ODE Operator Networks for PDEscited by 3
  29. 2025FMEnets: Flow, Material, and Energy networks for non-ideal plug flow reactor designcited by 2
  30. 2025A Survey of Physics-Informed AI for Complex Urban Systemscited by 2
  31. 2025Leveraging Influence Functions for Resampling Data in Physics-Informed Neural Networkscited by 2
  32. 2025Automating modeling in mechanics: LLMs as designers of physics-constrained neural networks for constitutive modeling of materialscited by 2
  33. 2026A Physics-Informed Fourier-Wavelet Transformer for Multiscale Computational Fluid Dynamics Surrogate Modelingcited by 2
  34. 2023Probing optimisation in physics-informed neural networkscited by 1
  35. 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
  36. 2024Understanding Learning through the Lens of Dynamical Invariantscited by 1
  37. 2024Kolmogorov n-Widths for Multitask Physics-Informed Machine Learning (PIML) Methods: Towards Robust Metricscited by 1
  38. 2024Discovering Artificial Viscosity Models for Discontinuous Galerkin Approximation of Conservation Laws using Physics-Informed Machine Learningcited by 1

50 most cited of 88 All 88 (JSON)