Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learning
Not on the map. Why?
Abstract (arXiv)
Experimental data is often affected by uncontrolled variables that make analysis and interpretation difficult. For spatiotemporal systems, this problem is further exacerbated by their intricate dynamics. Modern machine learning methods are particularly well-suited for analyzing and modeling complex datasets, but to be effective in science, the result needs to be interpretable. We demonstrate an unsupervised learning technique for extracting interpretable physical parameters from noisy spatiotemporal data and for building a transferable model of the system. In particular, we implement a physics-informed architecture based on variational autoencoders that is designed for analyzing systems governed by partial differential equations (PDEs). The architecture is trained end-to-end and extracts latent parameters that parameterize the dynamics of a learned predictive model for the system. To test our method, we train our model on simulated data from a variety of PDEs with varying dynamical parameters that act as uncontrolled variables. Numerical experiments show that our method can accurately identify relevant parameters and extract them from raw and even noisy spatiotemporal data (tested with roughly 10% added noise). These extracted parameters correlate well (linearly with R2 > 0.95) with the ground truth physical parameters used to generate the datasets. We then apply this method to nonlinear fiber propagation data, generated by an ab-initio simulation, to demonstrate its capabilities on a more realistic dataset. Our method for discovering interpretable latent parameters in spatiotemporal systems will allow us to better analyze and understand real-world phenomena and datasets, which often have unknown and uncontrolled variables that alter the system dynamics and cause varying behaviors that are difficult to disentangle.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 6; 2024: 1; 2025: 3; 2026: 1.
23 papers.
Sort:
- 2023Training neural operators to preserve invariant measures of chaotic attractorscited by 43
- 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
- 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)cited by 18
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detectioncited by 10
- 2023Explainable Representation Learning of Small Quantum Statescited by 10
- 2022GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductionscited by 7
- 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuitiescited by 7
- 2023Learning minimal representations of stochastic processes with variational autoencoderscited by 7
- 2021Surrogate- and invariance-boosted contrastive learning for data-scarce applications in sciencecited by 6
- 2021Disentangling Generative Factors of Physical Fields Using Variational Autoencoderscited by 5
11 more
- 2022Phi-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilationcited by 4
- 2025Unsupervised learning for anticipating critical transitionscited by 4
- 2021A Convolutional Neural Network-based Approach to Field Reconstructioncited by 1
- 2022Interpretable Boosted Decision Tree Analysis for the Majorana Demonstratorcited by 1
- 2022Neuro-symbolic partial differential equation solvercited by 1
- 2023Correlation between morphological evolution of splashing drop and exerted impact force revealed by interpretation of explainable artificial intelligencecited by 1
- 2024From Spectra to Biophysical Insights: End-to-End Learning with a Biased Radiative Transfer Modelcited by 1
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Designcited by 1
- 2023An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equationscited by 0
- 2023MP-FVM: Enhancing Finite Volume Method for Water Infiltration Modeling in Unsaturated Soils via Message-passing Encoder-decoder Networkcited by 0
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learningcited by 0
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Design10 Sep 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Unsupervised learning for anticipating critical transitions2 Jan 2025
- 2024From Spectra to Biophysical Insights: End-to-End Learning with a Biased Radiative Transfer Model5 Mar 2024
- 2023MP-FVM: Enhancing Finite Volume Method for Water Infiltration Modeling in Unsaturated Soils via Message-passing Encoder-decoder Network4 Oct 2023
- 2023Correlation between morphological evolution of splashing drop and exerted impact force revealed by interpretation of explainable artificial intelligence19 Sep 2023
- 2023Learning minimal representations of stochastic processes with variational autoencoders21 Jul 2023
- 2023An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations17 Jun 2023
- 2023Explainable Representation Learning of Small Quantum States9 Jun 2023
- 2023Training neural operators to preserve invariant measures of chaotic attractors1 Jun 2023
- 2022Neuro-symbolic partial differential equation solver25 Oct 2022
11 more
- 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuities25 Oct 2022
- 2022Phi-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilation30 Sep 2022
- 2022Interpretable Boosted Decision Tree Analysis for the Majorana Demonstrator21 Jul 2022
- 2022GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductions10 Jun 2022
- 2021Surrogate- and invariance-boosted contrastive learning for data-scarce applications in science15 Oct 2021
- 2021Disentangling Generative Factors of Physical Fields Using Variational Autoencoders15 Sep 2021
- 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)30 Aug 2021
- 2021A Convolutional Neural Network-based Approach to Field Reconstruction27 Aug 2021
- 2021Discovering Sparse Interpretable Dynamics from Partial Observations22 Jul 2021
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detection31 May 2021
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structure23 Apr 2021
- 2023Training neural operators to preserve invariant measures of chaotic attractorscited by 43
- 2021Discovering Sparse Interpretable Dynamics from Partial Observationscited by 25
- 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)cited by 18
- 2021Deep Learning for Bayesian Optimization of Scientific Problems with High-Dimensional Structurecited by 15
- 2025Interpretable Machine Learning in Physics: A Reviewcited by 11
- 2021Machine-Learning Non-Conservative Dynamics for New-Physics Detectioncited by 10
- 2023Explainable Representation Learning of Small Quantum Statescited by 10
- 2022GD-VAEs: Geometric Dynamic Variational Autoencoders for Learning Nonlinear Dynamics and Dimension Reductionscited by 7
- 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuitiescited by 7
- 2023Learning minimal representations of stochastic processes with variational autoencoderscited by 7
- 2021Surrogate- and invariance-boosted contrastive learning for data-scarce applications in sciencecited by 6
- 2021Disentangling Generative Factors of Physical Fields Using Variational Autoencoderscited by 5
12 most cited of 23 All 23 (JSON)
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2025Variational Rank Reduction Autoencoders for Generative Thermal Design10 Sep 2025
- 2025Interpretable Machine Learning in Physics: A Review30 Mar 2025
- 2025Unsupervised learning for anticipating critical transitions2 Jan 2025
- 2024From Spectra to Biophysical Insights: End-to-End Learning with a Biased Radiative Transfer Model5 Mar 2024
- 2023MP-FVM: Enhancing Finite Volume Method for Water Infiltration Modeling in Unsaturated Soils via Message-passing Encoder-decoder Network4 Oct 2023
- 2023Correlation between morphological evolution of splashing drop and exerted impact force revealed by interpretation of explainable artificial intelligence19 Sep 2023
- 2023Learning minimal representations of stochastic processes with variational autoencoders21 Jul 2023
- 2023An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations17 Jun 2023
- 2023Explainable Representation Learning of Small Quantum States9 Jun 2023
- 2023Training neural operators to preserve invariant measures of chaotic attractors1 Jun 2023
- 2022Neuro-symbolic partial differential equation solver25 Oct 2022
12 newest of 23 All 23 (JSON)