Interpretable Machine Learning in Physics: A Review
Not on the map. Why?
Abstract (arXiv)
Machine learning is increasingly transforming various scientific fields, enabled by advancements in computational power and access to large data sets from experiments and simulations. As artificial intelligence (AI) continues to grow in capability, these algorithms will enable many scientific discoveries beyond human capabilities. Since the primary goal of science is to understand the world around us, fully leveraging machine learning in scientific discovery requires models that are interpretable -- allowing experts to comprehend the concepts underlying machine-learned predictions. Successful interpretations increase trust in black-box methods, help reduce errors, allow for the improvement of the underlying models, enhance human-AI collaboration, and ultimately enable fully automated scientific discoveries that remain understandable to human scientists. This review examines the role of interpretability in machine learning applied to physics. We categorize different aspects of interpretability, discuss machine learning models in terms of both interpretability and performance, and explore the philosophical implications of interpretability in scientific inquiry. Additionally, we highlight recent advances in interpretable machine learning across many subfields of physics. By bridging boundaries between disciplines -- each with its own unique insights and challenges -- we aim to establish interpretable machine learning as a core research focus in science.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 163 of its 460 references that are in the map. First posted on arXiv 30 Mar 2025.
Builds on
163 of 460 references.
References · 163
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,400
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,201
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2018A Survey Of Methods For Explaining Black Box Modelscited by 970
38 more
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2019GNNExplainer: Generating Explanations for Graph Neural Networkscited by 735
- 2019Hamiltonian Neural Networkscited by 702
- 2018Disentangling by Factorisingcited by 614
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2018Towards Robust Interpretability with Self-Explaining Neural Networkscited by 505
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2016Reinforcement Learning with Unsupervised Auxiliary Taskscited by 400
- 2020Lagrangian Neural Networkscited by 388
- 2021Interpretable Machine Learning: Fundamental Principles and 10 Grand Challengescited by 364
- 2017Methods for Interpreting and Understanding Deep Neural Networkscited by 342
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 328
- 2019Interpretable machine learning: definitions, methods, and applicationscited by 303
- 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 294
- 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
- 2018Implicit Self-Regularization in Deep Neural Networks: Evidence from Random Matrix Theory and Implications for Learningcited by 211
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2022End-to-end symbolic regression with transformerscited by 195
- 2019Explainable Machine Learning for Scientific Insights and Discoveriescited by 165
- 2020AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularitycited by 140
- 2020Explainable Reinforcement Learning: A Surveycited by 139
- 2020Learning explanations that are hard to varycited by 132
- 2018State Representation Learning for Control: An Overviewcited by 125
- 2018Discovering physical concepts with neural networkscited by 117
- 2016Extrapolation and learning equationscited by 106
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2021Symbolic Regression via Neural-Guided Genetic Programming Population Seedingcited by 97
- 2019Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discoverycited by 93
- 2020AI Poincar'e: Machine Learning Conservation Laws from Trajectoriescited by 77
- 2017What Does Explainable AI Really Mean? A New Conceptualization of Perspectivescited by 72
- 2022Rediscovering orbital mechanics with machine learningcited by 71
- 2022On scientific understanding with artificial intelligencecited by 68
- 2019Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networkscited by 63
- 2020A Bayesian machine scientist to aid in the solution of challenging scientific problemscited by 61
- 2022Theory for Equivariant Quantum Neural Networkscited by 60
- 2020The Pragmatic Turn in Explainable Artificial Intelligence (XAI)cited by 53
50 most cited of 163 All 163 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025Artificial intelligence for representing and characterizing quantum systemscited by 9
- 2025Quantum computing and artificial intelligence: status and perspectivescited by 5
- 2026Explainable AI for Jet Tagging: A Comparative Study of GNNExplainer, GNNShap, and GradCAM for Jet Tagging in the Lund Jet Planecited by 3
- 2025Sequence-Model-Guided Measurement Selection for Quantum State Learningcited by 1
- 2026Automated near-term quantum algorithm discovery for molecular ground statescited by 1
- 2025MonoCon: A general framework for learning ultra-compact high-fidelity representations using monotonicity constraintscited by 0
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equationscited by 0
- 2026Interpretation of Crystal Energy Landscapes with Kolmogorov-Arnold Networkscited by 0
- 2026The limits of interpretability in multiple linear regressioncited by 0
- 2026How Complexity Contributes to Learning Opacity in Machine Learningcited by 0
- 2026A survey detection channel overrides the pixels in an astronomical foundation model, and biases tomographic mean redshiftscited by 0
- 2026A survey detection channel overrides the pixels in an astronomical foundation model, and biases tomographic mean redshifts23 Aug 2026
- 2026How Complexity Contributes to Learning Opacity in Machine Learning23 Jun 2026
- 2026The limits of interpretability in multiple linear regression14 Jun 2026
- 2026Explainable AI for Jet Tagging: A Comparative Study of GNNExplainer, GNNShap, and GradCAM for Jet Tagging in the Lund Jet Plane28 Apr 2026
- 2026Interpretation of Crystal Energy Landscapes with Kolmogorov-Arnold Networks6 Apr 2026
- 2026Automated near-term quantum algorithm discovery for molecular ground states27 Mar 2026
- 2025Capturing reduced-order quantum many-body dynamics out of equilibrium via neural ordinary differential equations15 Dec 2025
- 2025MonoCon: A general framework for learning ultra-compact high-fidelity representations using monotonicity constraints26 Sep 2025
- 2025Artificial intelligence for representing and characterizing quantum systems5 Sep 2025
- 2025Sequence-Model-Guided Measurement Selection for Quantum State Learning14 Jul 2025
- 2025Quantum computing and artificial intelligence: status and perspectives29 May 2025