Thermodynamics of learning physical phenomena
Not on the map. Why?
Abstract (arXiv)
Thermodynamics could be seen as an expression of physics at a high epistemic level. As such, its potential as an inductive bias to help machine learning procedures attain accurate and credible predictions has been recently realized in many fields. We review how thermodynamics provides helpful insights in the learning process. At the same time, we study the influence of aspects such as the scale at which a given phenomenon is to be described, the choice of relevant variables for this description or the different techniques available for the learning process.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 53 of its 150 references that are in the map. First posted on arXiv 26 Jul 2022.
Builds on
53 of 150 references.
References · 53
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021E(n) Equivariant Graph Neural Networkscited by 951
- 2019Hamiltonian Neural Networkscited by 702
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2016Input Convex Neural Networkscited by 407
- 2020Lagrangian Neural Networkscited by 388
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 205
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 182
38 more
- 2019Symplectic Recurrent Neural Networkscited by 148
- 2019Hamiltonian Generative Networkscited by 136
- 2020Simplifying Hamiltonian and Lagrangian Neural Networks via Explicit Constraintscited by 102
- 2022Approximately Equivariant Networks for Imperfectly Symmetric Dynamicscited by 95
- 2019Physics-Informed Neural Networks for Power Systemscited by 80
- 2020Dissipative SymODEN: Encoding Hamiltonian Dynamics with Dissipation and Control into Deep Learningcited by 77
- 2020NeuralSim: Augmenting Differentiable Simulators with Neural Networkscited by 77
- 2021Port-Hamiltonian Neural Networks for Learning Explicit Time-Dependent Dynamical Systemscited by 66
- 2018SPNets: Differentiable Fluid Dynamics for Deep Neural Networkscited by 62
- 2020Structure-preserving neural networkscited by 54
- 2021Machine learning structure preserving brackets for forecasting irreversible processescited by 51
- 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 48
- 2020Benchmarking Energy-Conserving Neural Networks for Learning Dynamics from Datacited by 40
- 2020Unsupervised Learning of Lagrangian Dynamics from Images for Prediction and Controlcited by 38
- 2020Deep learning of thermodynamics-aware reduced-order models from datacited by 38
- 2022Physical Design using Differentiable Learned Simulatorscited by 37
- 2021Symplectic Learning for Hamiltonian Neural Networkscited by 35
- 2020Hamiltonian neural networks for solving equations of motioncited by 33
- 2020Modeling System Dynamics with Physics-Informed Neural Networks Based on Lagrangian Mechanicscited by 32
- 2022Deconstructing the Inductive Biases of Hamiltonian Neural Networkscited by 31
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2022NN-EUCLID: deep-learning hyperelasticity without stress datacited by 30
- 2020Symplectic Neural Networks in Taylor Series Form for Hamiltonian Systemscited by 24
- 2020LagNetViP: A Lagrangian Neural Network for Video Predictioncited by 24
- 2020Machine Learning and Computational Mathematicscited by 22
- 2021Adaptable Hamiltonian neural networkscited by 21
- 2020Sparse Symplectically Integrated Neural Networkscited by 20
- 2018Model Reduction with Memory and the Machine Learning of Dynamical Systemscited by 19
- 2021Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Designcited by 18
- 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)cited by 18
- 2022Pseudo-Hamiltonian Neural Networks with State-Dependent External Forcescited by 17
- 2021Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approachcited by 12
- 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
- 2022A Thermodynamics-informed Active Learning Approach to Perception and Reasoning about Fluidscited by 9
- 2022Learning Neural Hamiltonian Dynamics: A Methodological Overviewcited by 8
- 2022Simulating Liquids with Graph Networkscited by 8
- 2018Robust port-Hamiltonian representations of passive systemscited by 4
- 2019Port-Hamiltonian Approach to Neural Network Trainingcited by 4
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 4; 2025: 4.
10 papers.
- 2022Port-metriplectic neural networks: thermodynamics-informed machine learning of complex physical systemscited by 11
- 2024Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous mediacited by 5
- 2024A comparison of Single- and Double-generator formalisms for Thermodynamics-Informed Neural Networkscited by 4
- 2024A hybrid numerical methodology coupling Reduced Order Modeling and Graph Neural Networks for non-parametric geometries: applications to structural dynamics problemscited by 3
- 2023Predicting and explaining nonlinear material response using deep Physically Guided Neural Networks with Internal Variablescited by 1
- 2024A POD-TANN approach for the multiscale modeling of materials and macroelement derivation in geomechanicscited by 1
- 2025Physics-based machine learning for fatigue lifetime prediction under non-uniform loading scenarioscited by 0
- 2025Learning thermodynamic master equations for open quantum systemscited by 0
- 2025Can Transformers overcome the lack of data in the simulation of history-dependent flows?cited by 0
- 2025GIMLET: Generalizable and Interpretable Model Learning through Embedded Thermodynamicscited by 0
- 2025GIMLET: Generalizable and Interpretable Model Learning through Embedded Thermodynamics22 Dec 2025
- 2025Can Transformers overcome the lack of data in the simulation of history-dependent flows?18 Dec 2025
- 2025Learning thermodynamic master equations for open quantum systems2 Jun 2025
- 2025Physics-based machine learning for fatigue lifetime prediction under non-uniform loading scenarios7 Mar 2025
- 2024A POD-TANN approach for the multiscale modeling of materials and macroelement derivation in geomechanics13 Aug 2024
- 2024A hybrid numerical methodology coupling Reduced Order Modeling and Graph Neural Networks for non-parametric geometries: applications to structural dynamics problems3 Jun 2024
- 2024Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media29 May 2024
- 2024A comparison of Single- and Double-generator formalisms for Thermodynamics-Informed Neural Networks1 Apr 2024
- 2023Predicting and explaining nonlinear material response using deep Physically Guided Neural Networks with Internal Variables7 Aug 2023
- 2022Port-metriplectic neural networks: thermodynamics-informed machine learning of complex physical systems3 Nov 2022