Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification
Not on the map. Why?
Abstract (arXiv)
This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a corresponding multichannel time series. Our task is to accurately estimate a range of likely values of the underlying parameters. Standard iterative approaches necessitate running the simulator many times, which is computationally prohibitive. This paper describes a novel framework for learning feature embeddings of observed dynamics jointly with an emulator that can replace high-cost simulators for parameter estimation. Leveraging a contrastive learning approach, our method exploits intrinsic data properties within and across parameter and trajectory domains. On a coupled 396-dimensional multiscale Lorenz 96 system, our method significantly outperforms a typical parameter estimation method based on predefined metrics and a classical numerical simulator, and with only 1.19% of the baseline's computation time. Ablation studies highlight the potential of explicitly designing learned emulators for parameter estimation by leveraging contrastive learning.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 76 references that are in the map. First posted on arXiv 3 Nov 2022.
Builds on
35 of 76 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2020Supervised Contrastive Learningcited by 2,803
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
23 more
- 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
- 2019The frontier of simulation-based inferencecited by 490
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
- 2021Contrastive Learning Inverts the Data Generating Processcited by 220
- 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
- 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
- 2020Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Datacited by 179
- 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
- 2021Benchmarking Simulation-Based Inferencecited by 160
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
- 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 132
- 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
- 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 72
- 2016By-passing the Kohn-Sham equations with machine learningcited by 65
- 2020Self-Supervised Visual Representation Learning from Hierarchical Groupingcited by 63
- 2018Likelihood-free inference with emulator networkscited by 61
- 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
- 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
- 2018Heated-Up Softmax Embeddingcited by 15
- 2020Iterative Ensemble Kalman Methods: A Unified Perspective with Some New Variantscited by 13
- 2019Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: Reservoir computing, ANN, and RNN-LSTMcited by 9
- 2021Inverse Problems Leveraging Pre-trained Contrastive Representationscited by 7
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 0; 2026: 1.
5 papers.
- 2023Training neural operators to preserve invariant measures of chaotic attractorscited by 43
- 2024Embed and Emulate: Contrastive representations for simulation-based inferencecited by 3
- 2023Deep Stochastic Mechanicscited by 2
- 2023Structural Adversarial Objectives for Self-Supervised Representation Learningcited by 2
- 2026Can AI Follow In Einstein's Footsteps?cited by 0
- 2026Can AI Follow In Einstein's Footsteps?30 Jul 2026
- 2024Embed and Emulate: Contrastive representations for simulation-based inference27 Sep 2024
- 2023Structural Adversarial Objectives for Self-Supervised Representation Learning30 Sep 2023
- 2023Training neural operators to preserve invariant measures of chaotic attractors1 Jun 2023
- 2023Deep Stochastic Mechanics31 May 2023