Stochastic Deep Learning: A Probabilistic Framework for Modeling Uncertainty in Structured Temporal Data
Not on the map. Why?
Abstract (arXiv)
I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach, termed Stochastic Latent Differential Inference (SLDI), embeds an Ito SDE in the latent space of a variational autoencoder, allowing for flexible, continuous-time modeling of uncertainty while preserving a principled mathematical foundation. The drift and diffusion terms of the SDE are parameterized by neural networks, enabling data-driven inference and generalizing classical time series models to handle irregular sampling and complex dynamic structure. A central theoretical contribution is the co-parameterization of the adjoint state with a dedicated neural network, forming a coupled forward-backward system that captures not only latent evolution but also gradient dynamics. I introduce a pathwise-regularized adjoint loss and analyze variance-reduced gradient flows through the lens of stochastic calculus, offering new tools for improving training stability in deep latent SDEs. My paper unifies and extends variational inference, continuous-time generative modeling, and control-theoretic optimization, providing a rigorous foundation for future developments in stochastic probabilistic machine learning.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 23 of its 44 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
23 of 44 references.
References · 23
- 2017Attention Is All You Needcited by 60,106
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,870
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,430
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2018Neural Ordinary Differential Equationscited by 3,750
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,340
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,621
- 2016Variational Inference: A Review for Statisticianscited by 1,469
- 2016Deep Variational Information Bottleneckcited by 924
- 2017Wasserstein GANcited by 636
- 2016Learning to learn by gradient descent by gradient descentcited by 617
11 more
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2018Understanding disentangling in β-VAEcited by 334
- 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 173
- 2021Neural SDEs as Infinite-Dimensional GANscited by 161
- 2016Sequential Neural Models with Stochastic Layerscited by 115
- 2017REBAR: Low-variance, unbiased gradient estimates for discrete latent variable modelscited by 79
- 2016PixelVAE: A Latent Variable Model for Natural Imagescited by 70
- 2019Structured Output Learning with Conditional Generative Flowscited by 37
- 2015Black box variational inference for state space modelscited by 31
- 2018Recurrent Neural Network-Based Semantic Variational Autoencoder for Sequence-to-Sequence Learningcited by 4
- 2024An Efficient High-Dimensional Gradient Estimator for Stochastic Differential Equationscited by 4
Built on by
Not cited yet.