mlsanityData to 7 Oct 2026

Learning minimal representations of stochastic processes with variational autoencoders

arXiv 2307.11608 ↗First posted 21 Jul 2023cond-mat.soft cs.LG physics.bio-phcited by 7

Not on the map. Why?

Abstract (arXiv)

Stochastic processes have found numerous applications in science, as they are broadly used to model a variety of natural phenomena. Due to their intrinsic randomness and uncertainty, they are, however, difficult to characterize. Here, we introduce an unsupervised machine learning approach to determine the minimal set of parameters required to effectively describe the dynamics of a stochastic process. Our method builds upon an extended β-variational autoencoder architecture. By means of simulated datasets corresponding to paradigmatic diffusion models, we showcase its effectiveness in extracting the minimal relevant parameters that accurately describe these dynamics. Furthermore, the method enables the generation of new trajectories that faithfully replicate the expected stochastic behavior. Overall, our approach enables the autonomous discovery of unknown parameters describing stochastic processes, hence enhancing our comprehension of complex phenomena across various fields.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 27 of its 74 references that are in the map. First posted on arXiv 21 Jul 2023.

Builds on

27 of 74 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  6. 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
  7. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  8. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  9. 2015Generating Sentences from a Continuous Spacecited by 607
  10. 2018Understanding disentangling in β-VAEcited by 332
  11. 2018A disciplined approach to neural network hyper-parameters: Part 1 -- learning rate, batch size, momentum, and weight decaycited by 223
  12. 2022Recurrent Memory Transformercited by 197
15 more
  1. 2020fastai: A Layered API for Deep Learningcited by 183
  2. 2017DARLA: Improving Zero-Shot Transfer in Reinforcement Learningcited by 147
  3. 2022Interventional Causal Representation Learningcited by 140
  4. 2018Discovering physical concepts with neural networkscited by 117
  5. 2019Unsupervised speech representation learning using WaveNet autoencoderscited by 90
  6. 2019DeepMoD: Deep learning for Model Discovery in noisy datacited by 70
  7. 2017Unsupervised learning of phase transitions: from principal component analysis to variational autoencoderscited by 47
  8. 2017Active learning machine learns to create new quantum experimentscited by 41
  9. 2019Dynamics-aware Embeddingscited by 34
  10. 2019Extracting Interpretable Physical Parameters from Spatiotemporal Systems using Unsupervised Learningcited by 23
  11. 2020Computer-inspired Quantum Experimentscited by 18
  12. 2020Operationally meaningful representations of physical systems in neural networkscited by 16
  13. 2020Correlator Convolutional Neural Networks: An Interpretable Architecture for Image-like Quantum Matter Datacited by 13
  14. 2020Towards Novel Insights in Lattice Field Theory with Explainable Machine Learningcited by 12
  15. 2021Unsupervised learning of anomalous diffusion datacited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 1.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Introduction to Stochastic Differential Equations for Generative Machine Learning: A Variational Perspective
  2. 2024eXponential FAmily Dynamical Systems (XFADS): Large-scale nonlinear Gaussian state-space modeling
  3. 2025A Frequentist Statistical Introduction to Variational Inference, Autoencoders, and Diffusion Models
  4. 2026Generative Modeling of Stochastic Dynamics for Long-Time Evolution
  5. 2025Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems
  6. 2025The Principles of Diffusion Models
  7. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
  8. 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty