Learning Stochastic Recurrent Networks
Not on the map. Why?
Abstract (arXiv)
Leveraging advances in variational inference, we propose to enhance recurrent neural networks with latent variables, resulting in Stochastic Recurrent Networks (STORNs). The model i) can be trained with stochastic gradient methods, ii) allows structured and multi-modal conditionals at each time step, iii) features a reliable estimator of the marginal likelihood and iv) is a generalisation of deterministic recurrent neural networks. We evaluate the method on four polyphonic musical data sets and motion capture data.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 21; 2022: 17; 2023: 8; 2024: 5; 2025: 7; 2026: 1.
60 papers.
Sort:
By area:
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 67
- 2021Anomaly Detection of Time Series with Smoothness-Inducing Sequential Variational Auto-Encodercited by 39
- 2022Deep Latent State Space Models for Time-Series Generationcited by 38
- 2023Deep networks for system identification: a Surveycited by 37
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Bayesian Attention Belief Networkscited by 25
- 2022Conditional Motion In-betweeningcited by 25
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videoscited by 18
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecastingcited by 16
38 more
- 2021CLVSA: A Convolutional LSTM Based Variational Sequence-to-Sequence Model with Attention for Predicting Trends of Financial Marketscited by 15
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
- 2021A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Predictioncited by 10
- 2022Low-Rank Constraints for Fast Inference in Structured Modelscited by 8
- 2021Innovations Autoencoder and its Application in One-class Anomalous Sequence Detectioncited by 7
- 2023Discussing the Spectrum of Physics-Enhanced Machine Learning; a Survey on Structural Mechanics Applicationscited by 7
- 2021VDSM: Unsupervised Video Disentanglement with State-Space Modeling and Deep Mixtures of Expertscited by 6
- 2021Policy Gradients Incorporating the Futurecited by 6
- 2022Competency Assessment for Autonomous Agents using Deep Generative Modelscited by 6
- 2023Continuous-time Autoencoders for Regular and Irregular Time Series Imputationcited by 6
- 2019Hierarchical Variational Imitation Learning of Control Programscited by 5
- 2022Phi-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilationcited by 5
- 2024A probabilistic framework for learning non-intrusive corrections to long-time climate simulations from short-time training datacited by 5
- 2023Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenescited by 4
- 2021Deep Stochastic Volatility Modelcited by 2
- 2022Learning Deep Input-Output Stable Dynamicscited by 2
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictionscited by 2
- 2024Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systemscited by 2
- 2025Deep Belief Markov Models for POMDP Inferencecited by 2
- 2021Stochastic Recurrent Neural Network for Multistep Time Series Forecastingcited by 1
- 2021Monte Carlo Filtering Objectives: A New Family of Variational Objectives to Learn Generative Model and Neural Adaptive Proposal for Time Seriescited by 1
- 2021Deep Neural Networks and End-to-End Learning for Audio Compressioncited by 1
- 2021Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systemscited by 1
- 2021Regularized Sequential Latent Variable Models with Adversarial Neural Networkscited by 1
- 2022Neural Generalised AutoRegressive Conditional Heteroskedasticitycited by 1
- 2022Flat Latent Manifolds for Human-machine Co-creation of Musiccited by 1
- 2022Benchmarking Generative Latent Variable Models for Speechcited by 1
- 2022Wildfire Forecasting with Satellite Images and Deep Generative Modelcited by 1
- 2023Learning Mixture Structure on Multi-Source Time Series for Probabilistic Forecastingcited by 1
- 2023Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Datacited by 1
- 2025Towards Foundation Auto-Encoders for Time-Series Anomaly Detectioncited by 1
- 2025FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Predictioncited by 1
- 2025Double projection for reconstructing dynamical systems: between stochastic and deterministic regimescited by 1
- 2026SELDON: Supernova Explosions Learned by Deep ODE Networkscited by 1
- 2021Learning deep autoregressive models for hierarchical datacited by 0
- 2021Switching Recurrent Kalman Networkscited by 0
- 2021Estimating the Value-at-Risk by Temporal VAEcited by 0
50 most cited of 60 All 60 (JSON)
- 2026SELDON: Supernova Explosions Learned by Deep ODE Networks4 Mar 2026
- 2025Autoregressivity in the Latent Space of a GP-VAE Language Model: An Empirical Ablation Study30 Dec 2025
- 2025Double projection for reconstructing dynamical systems: between stochastic and deterministic regimes1 Oct 2025
- 2025StoxLSTM: A Stochastic Extended Long Short-Term Memory Network for Time Series Forecasting1 Sep 2025
- 2025FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Prediction11 Aug 2025
- 2025Towards Foundation Auto-Encoders for Time-Series Anomaly Detection2 Jul 2025
- 2025Alternators With Noise Models18 May 2025
- 2025Deep Belief Markov Models for POMDP Inference17 Mar 2025
- 2024Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems2 Oct 2024
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videos4 Sep 2024
- 2024Rethinking Molecular Design: Integrating Latent Variable and Auto-Regressive Models for Goal Directed Generation19 Aug 2024
- 2024A probabilistic framework for learning non-intrusive corrections to long-time climate simulations from short-time training data2 Aug 2024
38 more
- 2024Explain Variance of Prediction in Variational Time Series Models for Clinical Deterioration Prediction9 Feb 2024
- 2023Continuous-time Autoencoders for Regular and Irregular Time Series Imputation27 Dec 2023
- 2023Exploiting the capacity of deep networks only at training stage for nonlinear black-box system identification26 Dec 2023
- 2023Discussing the Spectrum of Physics-Enhanced Machine Learning; a Survey on Structural Mechanics Applications31 Oct 2023
- 2023Causal Dynamic Variational Autoencoder for Counterfactual Regression in Longitudinal Data16 Oct 2023
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecasting17 Jul 2023
- 2023Temporal Conditioning Spiking Latent Variable Models of the Neural Response to Natural Visual Scenes21 Jun 2023
- 2023Learning Mixture Structure on Multi-Source Time Series for Probabilistic Forecasting22 Feb 2023
- 2023Deep networks for system identification: a Survey30 Jan 2023
- 2022Deep Latent State Space Models for Time-Series Generation24 Dec 2022
- 2022State-Regularized Recurrent Neural Networks to Extract Automata and Explain Predictions10 Dec 2022
- 2022Predicting phoneme-level prosody latents using AR and flow-based Prior Networks for expressive speech synthesis2 Nov 2022
- 2022Phi-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilation30 Sep 2022
- 2022Wildfire Forecasting with Satellite Images and Deep Generative Model19 Aug 2022
- 2022Learning Deep Input-Output Stable Dynamics27 Jun 2022
- 2022Variational Heteroscedastic Volatility Model11 Apr 2022
- 2022Competency Assessment for Autonomous Agents using Deep Generative Models23 Mar 2022
- 2022Diffusion Probabilistic Modeling for Video Generation16 Mar 2022
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latents15 Mar 2022
- 2022Interpretable Latent Variables in Deep State Space Models3 Mar 2022
- 2022Flat Latent Manifolds for Human-machine Co-creation of Music23 Feb 2022
- 2022Neural Generalised AutoRegressive Conditional Heteroskedasticity23 Feb 2022
- 2022Benchmarking Generative Latent Variable Models for Speech22 Feb 2022
- 2022Conditional Motion In-betweening9 Feb 2022
- 2022Dual-CLVSA: a Novel Deep Learning Approach to Predict Financial Markets with Sentiment Measurements27 Jan 2022
- 2022Low-Rank Constraints for Fast Inference in Structured Models8 Jan 2022
- 2021Estimating the Value-at-Risk by Temporal VAE3 Dec 2021
- 2021Modeling Irregular Time Series with Continuous Recurrent Units22 Nov 2021
- 2021Switching Recurrent Kalman Networks16 Nov 2021
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertainty16 Oct 2021
- 2021A Hierarchical Variational Neural Uncertainty Model for Stochastic Video Prediction6 Oct 2021
- 2021Regularized Sequential Latent Variable Models with Adversarial Neural Networks10 Aug 2021
- 2021Policy Gradients Incorporating the Future4 Aug 2021
- 2021Innovations Autoencoder and its Application in One-class Anomalous Sequence Detection23 Jun 2021
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoders23 Jun 2021
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecasting10 Jun 2021
- 2021Bayesian Attention Belief Networks9 Jun 2021
- 2021Deep Probabilistic Time Series Forecasting using Augmented Recurrent Input for Dynamic Systems3 Jun 2021
50 newest of 60 All 60 (JSON)
- 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
- 2024MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videoscited by 18
- 2025Alternators With Noise Modelscited by 0
- 2022Deep Latent State Space Models for Time-Series Generationcited by 38
- 2022Deep Latent State Space Models for Time-Series Generation24 Dec 2022
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2022SocialVAE: Human Trajectory Prediction using Timewise Latentscited by 67
- 2021Anomaly Detection of Time Series with Smoothness-Inducing Sequential Variational Auto-Encodercited by 39
- 2023Deep networks for system identification: a Surveycited by 37
- 2023Uncertainty-aware State Space Transformer for Egocentric 3D Hand Trajectory Forecastingcited by 34
- 2021Unsupervised Speech Enhancement using Dynamical Variational Auto-Encoderscited by 28
- 2021Bayesian Attention Belief Networkscited by 25
- 2022Conditional Motion In-betweeningcited by 25
- 2021RNN with Particle Flow for Probabilistic Spatio-temporal Forecastingcited by 16
- 2021CLVSA: A Convolutional LSTM Based Variational Sequence-to-Sequence Model with Attention for Predicting Trends of Financial Marketscited by 15
- 2021Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Modelscited by 14
- 2021Physics-guided Deep Markov Models for Learning Nonlinear Dynamical Systems with Uncertaintycited by 11
12 most cited of 53 All 53 (JSON)
- 2026SELDON: Supernova Explosions Learned by Deep ODE Networks4 Mar 2026
- 2025Autoregressivity in the Latent Space of a GP-VAE Language Model: An Empirical Ablation Study30 Dec 2025
- 2025Double projection for reconstructing dynamical systems: between stochastic and deterministic regimes1 Oct 2025
- 2025StoxLSTM: A Stochastic Extended Long Short-Term Memory Network for Time Series Forecasting1 Sep 2025
- 2025FairDRL-ST: Disentangled Representation Learning for Fair Spatio-Temporal Mobility Prediction11 Aug 2025
- 2025Towards Foundation Auto-Encoders for Time-Series Anomaly Detection2 Jul 2025
- 2025Deep Belief Markov Models for POMDP Inference17 Mar 2025
- 2024Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems2 Oct 2024
- 2024Rethinking Molecular Design: Integrating Latent Variable and Auto-Regressive Models for Goal Directed Generation19 Aug 2024
- 2024A probabilistic framework for learning non-intrusive corrections to long-time climate simulations from short-time training data2 Aug 2024
- 2024Explain Variance of Prediction in Variational Time Series Models for Clinical Deterioration Prediction9 Feb 2024
- 2023Continuous-time Autoencoders for Regular and Irregular Time Series Imputation27 Dec 2023
12 newest of 53 All 53 (JSON)