Discovering physical concepts with neural networks
Not on the map. Why?
Abstract (arXiv)
Despite the success of neural networks at solving concrete physics problems, their use as a general-purpose tool for scientific discovery is still in its infancy. Here, we approach this problem by modelling a neural network architecture after the human physical reasoning process, which has similarities to representation learning. This allows us to make progress towards the long-term goal of machine-assisted scientific discovery from experimental data without making prior assumptions about the system. We apply this method to toy examples and show that the network finds the physically relevant parameters, exploits conservation laws to make predictions, and can help to gain conceptual insights, e.g. Copernicus' conclusion that the solar system is heliocentric.
Key facts. Cited by 117 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 21; 2023: 25; 2024: 13; 2025: 17; 2026: 12.
117 papers.
Sort:
By area:
- 2022SELFIES and the future of molecular string representationscited by 76
- 2022On scientific understanding with artificial intelligencecited by 70
- 2025What Has a Foundation Model Found? Using Inductive Bias to Probe for World Modelscited by 47
- 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 45
- 2021Power-law escape rate of SGDcited by 29
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
- 2021Machine-Learning Mathematical Structurescited by 25
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2021Adaptable Hamiltonian neural networkscited by 21
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
- 2022Improving aircraft performance using machine learning: a reviewcited by 19
- 2023Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbertcited by 18
38 more
- 2021MC-LSTM: Mass-Conserving LSTMcited by 17
- 2021Solving time dependent Fokker-Planck equations via temporal normalizing flowcited by 17
- 2023Latent Traversals in Generative Models as Potential Flowscited by 17
- 2022Flexible learning of quantum states with generative query neural networkscited by 16
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 14
- 2024Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systemscited by 13
- 2021Learning Interpretable Representations of Entanglement in Quantum Optics Experiments using Deep Generative Modelscited by 12
- 2022Quantum Similarity Testing with Convolutional Neural Networkscited by 10
- 2023Explainable Representation Learning of Small Quantum Statescited by 10
- 2024Generalized Lagrangian Neural Networkscited by 10
- 2025Artificial intelligence for representing and characterizing quantum systemscited by 10
- 2023Metalearning generalizable dynamics from trajectoriescited by 9
- 2023Physics-informed Information Field Theory for Modeling Physical Systems with Uncertainty Quantificationcited by 9
- 2023Symbolic Regression via Control Variable Genetic Programmingcited by 9
- 2021Discovering conservation laws from trajectories via machine learningcited by 8
- 2021Disentangled Generative Models for Robust Prediction of System Dynamicscited by 8
- 2021AI Descartes: Combining Data and Theory for Derivable Scientific Discoverycited by 8
- 2021Accelerating Understanding of Scientific Experiments with End to End Symbolic Regressioncited by 8
- 2022Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regressioncited by 8
- 2023Discovering Sparse Representations of Lie Groups with Machine Learningcited by 8
- 2022A Review of Machine Learning Methods Applied to Structural Dynamics and Vibroacousticcited by 7
- 2023Learning minimal representations of stochastic processes with variational autoencoderscited by 7
- 2024Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation lawcited by 7
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025Learning mechanical systems from real-world data using discrete forced Lagrangian dynamicscited by 7
- 2025Inverse Design in Nanophotonics via Representation Learningcited by 7
- 2025The Need for Verification in AI-Driven Scientific Discoverycited by 7
- 2021Manifold Learning for Knowledge Discovery and Intelligent Inverse Design of Photonic Nanostructures: Breaking the Geometric Complexitycited by 6
- 2023Accelerated Discovery of Machine-Learned Symmetries: Deriving the Exceptional Lie Groups G2, F4 and E6cited by 6
- 2023Identifying the Group-Theoretic Structure of Machine-Learned Symmetriescited by 6
- 2024Vertical Symbolic Regression via Deep Policy Gradientcited by 6
- 2024Oil & Water? Diffusion of AI Within and Across Scientific Fieldscited by 6
- 2025Quantum computing and artificial intelligence: status and perspectivescited by 6
- 2025Interpretable representation learning of quantum data enabled by probabilistic variational autoencoderscited by 6
- 2022Discovering the building blocks of dark matter halo density profiles with neural networkscited by 5
- 2023Oracle-Preserving Latent Flowscited by 5
- 2023Deep Quantum Graph Dreaming: Deciphering Neural Network Insights into Quantum Experimentscited by 5
- 2025AI-Newton: A Concept-Driven Physical Law Discovery System without Prior Physical Knowledgecited by 5
50 most cited of 117 All 117 (JSON)
- 2026Multi-layer MIMO Relay as Deep Physical Neural Networks: Power Amplifiers as Activation Functions20 Jul 2026
- 2026Interpreting "Interpretability" and Explaining "Explainability" in Machine Learning in Physics24 Jun 2026
- 2026S2COPE: Self-Supervised Concept Discovery via Preference Learning12 Jun 2026
- 2026Flow map learning in nonlinear vector autoregressive models: influence of the feature-library structure on the training error29 May 2026
- 2026What Physics do Data-Driven MoCap-to-Radar Models Learn?19 Apr 2026
- 2026Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data19 Apr 2026
- 2026Relay-Assisted Activation-Integrated SIM for Wireless Physical Neural Networks5 Apr 2026
- 2026Hyperelastic constitutive model discovery with differentiable finite elements and structure-preserving neural networks27 Mar 2026
- 2026Murmurations: a case study in AI-assisted mathematics10 Mar 2026
- 2026CoVAE: correlated multimodal generative modeling2 Mar 2026
- 2026Disentanglement by means of action-induced representations6 Feb 2026
- 2026Sensoformer: Robust Sim-to-Real Inference on Variable-Geometry Sensor Sets via Physics-Structured Randomization9 Jan 2026
38 more
- 2025Unifying Causal Reinforcement Learning: Survey, Taxonomy, Algorithms and Applications19 Dec 2025
- 2025Learning Minimal Representations of Many-Body Physics from Snapshots of a Quantum Simulator17 Sep 2025
- 2025Artificial intelligence for representing and characterizing quantum systems5 Sep 2025
- 2025The Need for Verification in AI-Driven Scientific Discovery1 Sep 2025
- 2025Learning with Mandelbrot and Julia31 Aug 2025
- 2025A Multi-Task Evaluation of LLMs' Processing of Academic Text Input15 Aug 2025
- 2025Sequence-Model-Guided Measurement Selection for Quantum State Learning14 Jul 2025
- 2025What Has a Foundation Model Found? Using Inductive Bias to Probe for World Models9 Jul 2025
- 2025Inverse Design in Nanophotonics via Representation Learning1 Jul 2025
- 2025Interpretable representation learning of quantum data enabled by probabilistic variational autoencoders13 Jun 2025
- 2025Quantum computing and artificial intelligence: status and perspectives29 May 2025
- 2025Learning mechanical systems from real-world data using discrete forced Lagrangian dynamics26 May 2025
- 2025Physics-Guided Learning of Meteorological Dynamics for Weather Downscaling and Forecasting20 May 2025
- 2025Learning symmetries in datasets7 Apr 2025
- 2025AI-Newton: A Concept-Driven Physical Law Discovery System without Prior Physical Knowledge2 Apr 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Learning finite symmetry groups of dynamical systems via equivariance detection4 Mar 2025
- 2024Discover physical concepts and equations with machine learning11 Dec 2024
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
- 2024A Phenomenological AI Foundation Model for Physical Signals15 Oct 2024
- 2024Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systems2 Oct 2024
- 2024KALE-LM-Chem: Vision and Practice Toward an AI Brain for Chemistry27 Sep 2024
- 2024Closed-Form Interpretation of Neural Network Latent Spaces with Symbolic Gradients9 Sep 2024
- 2024Active Symbolic Discovery of Ordinary Differential Equations via Phase Portrait Sketching2 Sep 2024
- 2024Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation law4 Jun 2024
- 2024Oil & Water? Diffusion of AI Within and Across Scientific Fields24 May 2024
- 2024GN-SINDy: Greedy Sampling Neural Network in Sparse Identification of Nonlinear Partial Differential Equations14 May 2024
- 2024Vertical Symbolic Regression via Deep Policy Gradient1 Feb 2024
- 2024Exploring the Truth and Beauty of Theory Landscapes with Machine Learning21 Jan 2024
- 2024Generalized Lagrangian Neural Networks8 Jan 2024
- 2023Vertical Symbolic Regression19 Dec 2023
- 2023Position Paper on Materials Design -- A Modern Approach18 Dec 2023
- 2023Seeking Truth and Beauty in Flavor Physics with Machine Learning31 Oct 2023
- 2023Identifying the Group-Theoretic Structure of Machine-Learned Symmetries14 Sep 2023
- 2023Efficient Learning of PDEs via Taylor Expansion and Sparse Decomposition into Value and Fourier Domains13 Sep 2023
- 2023Deep Quantum Graph Dreaming: Deciphering Neural Network Insights into Quantum Experiments13 Sep 2023
- 2023Inferring physical laws by artificial intelligence based causal models8 Sep 2023
- 2023Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbert18 Aug 2023
50 newest of 117 All 117 (JSON)
- 2022SELFIES and the future of molecular string representationscited by 76
- 2022On scientific understanding with artificial intelligencecited by 70
- 2021Towards extraction of orthogonal and parsimonious non-linear modes from turbulent flowscited by 45
- 2021Power-law escape rate of SGDcited by 29
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
- 2021Machine-Learning Mathematical Structurescited by 25
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2021Adaptable Hamiltonian neural networkscited by 21
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
- 2022Improving aircraft performance using machine learning: a reviewcited by 19
- 2023Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbertcited by 18
- 2021MC-LSTM: Mass-Conserving LSTMcited by 17
12 most cited of 112 All 112 (JSON)
- 2026Multi-layer MIMO Relay as Deep Physical Neural Networks: Power Amplifiers as Activation Functions20 Jul 2026
- 2026Interpreting "Interpretability" and Explaining "Explainability" in Machine Learning in Physics24 Jun 2026
- 2026Flow map learning in nonlinear vector autoregressive models: influence of the feature-library structure on the training error29 May 2026
- 2026What Physics do Data-Driven MoCap-to-Radar Models Learn?19 Apr 2026
- 2026Machine Learning Hamiltonian Dynamical Systems with Sparse and Noisy Data19 Apr 2026
- 2026Relay-Assisted Activation-Integrated SIM for Wireless Physical Neural Networks5 Apr 2026
- 2026Hyperelastic constitutive model discovery with differentiable finite elements and structure-preserving neural networks27 Mar 2026
- 2026Murmurations: a case study in AI-assisted mathematics10 Mar 2026
- 2026CoVAE: correlated multimodal generative modeling2 Mar 2026
- 2026Disentanglement by means of action-induced representations6 Feb 2026
- 2026Sensoformer: Robust Sim-to-Real Inference on Variable-Geometry Sensor Sets via Physics-Structured Randomization9 Jan 2026
- 2025Learning Minimal Representations of Many-Body Physics from Snapshots of a Quantum Simulator17 Sep 2025
12 newest of 112 All 112 (JSON)