mlsanityData to 7 Oct 2026

Embed and Emulate: Learning to estimate parameters of dynamical systems with uncertainty quantification

arXiv 2211.01554 ↗First posted 3 Nov 2022cs.LG cs.NA math.NAcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a corresponding multichannel time series. Our task is to accurately estimate a range of likely values of the underlying parameters. Standard iterative approaches necessitate running the simulator many times, which is computationally prohibitive. This paper describes a novel framework for learning feature embeddings of observed dynamics jointly with an emulator that can replace high-cost simulators for parameter estimation. Leveraging a contrastive learning approach, our method exploits intrinsic data properties within and across parameter and trajectory domains. On a coupled 396-dimensional multiscale Lorenz 96 system, our method significantly outperforms a typical parameter estimation method based on predefined metrics and a classical numerical simulator, and with only 1.19% of the baseline's computation time. Ablation studies highlight the potential of explicitly designing learned emulators for parameter estimation by leveraging contrastive learning.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 35 of its 76 references that are in the map. First posted on arXiv 3 Nov 2022.

Builds on

35 of 76 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2020Supervised Contrastive Learningcited by 2,803
  10. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  11. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  12. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
23 more
  1. 2019A Theoretical Analysis of Contrastive Unsupervised Representation Learningcited by 530
  2. 2019The frontier of simulation-based inferencecited by 490
  3. 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
  4. 2021Contrastive Learning Inverts the Data Generating Processcited by 220
  5. 2018Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flowscited by 217
  6. 2019Automatic Posterior Transformation for Likelihood-Free Inferencecited by 216
  7. 2020Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Datacited by 179
  8. 2017Flexible statistical inference for mechanistic models of neural dynamicscited by 162
  9. 2021Benchmarking Simulation-Based Inferencecited by 160
  10. 2018Deep learning to represent sub-grid processes in climate modelscited by 156
  11. 2018Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long Short-Term Memory Networkscited by 155
  12. 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 132
  13. 2020Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: a case study with the Lorenz 96 modelcited by 72
  14. 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 72
  15. 2016By-passing the Kohn-Sham equations with machine learningcited by 65
  16. 2020Self-Supervised Visual Representation Learning from Hierarchical Groupingcited by 63
  17. 2018Likelihood-free inference with emulator networkscited by 61
  18. 2017Earth System Modeling 2.0: A Blueprint for Models That Learn From Observations and Targeted High-Resolution Simulationscited by 51
  19. 2019Machine Learning for Stochastic Parameterization: Generative Adversarial Networks in the Lorenz '96 Modelcited by 45
  20. 2018Heated-Up Softmax Embeddingcited by 15
  21. 2020Iterative Ensemble Kalman Methods: A Unified Perspective with Some New Variantscited by 13
  22. 2019Data-driven prediction of a multi-scale Lorenz 96 chaotic system using deep learning methods: Reservoir computing, ANN, and RNN-LSTMcited by 9
  23. 2021Inverse Problems Leveraging Pre-trained Contrastive Representationscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 1; 2025: 0; 2026: 1.

5 papers.