mlsanityData to 7 Oct 2026

Neural State-Space Modeling with Latent Causal-Effect Disentanglement

arXiv 2209.12387 ↗First posted 26 Sep 2022cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite substantial progress in deep learning approaches to time-series reconstruction, no existing methods are designed to uncover local activities with minute signal strength due to their negligible contribution to the optimization loss. Such local activities however can signify important abnormal events in physiological systems, such as an extra foci triggering an abnormal propagation of electrical waves in the heart. We discuss a novel technique for reconstructing such local activity that, while small in signal strength, is the cause of subsequent global activities that have larger signal strength. Our central innovation is to approach this by explicitly modeling and disentangling how the latent state of a system is influenced by potential hidden internal interventions. In a novel neural formulation of state-space models (SSMs), we first introduce causal-effect modeling of the latent dynamics via a system of interacting neural ODEs that separately describes 1) the continuous-time dynamics of the internal intervention, and 2) its effect on the trajectory of the system's native state. Because the intervention can not be directly observed but have to be disentangled from the observed subsequent effect, we integrate knowledge of the native intervention-free dynamics of a system, and infer the hidden intervention by assuming it to be responsible for differences observed between the actual and hypothetical intervention-free dynamics. We demonstrated a proof-of-concept of the presented framework on reconstructing ectopic foci disrupting the course of normal cardiac electrical propagation from remote observations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 26 Sep 2022.

Builds on

14 of 19 references.

References · 14

  1. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2015Cyclical Learning Rates for Training Neural Networkscited by 627
  4. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 230
  5. 2019Latent ODEs for Irregularly-Sampled Time Seriescited by 182
  6. 2015Deep Kalman Filterscited by 163
  7. 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
  8. 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
  9. 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 93
  10. 2019ODE2VAE: Deep generative second order ODEs with Bayesian neural networkscited by 36
  11. 2021Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecastingcited by 29
  12. 2020Neural Ordinary Differential Equations for Intervention Modelingcited by 19
2 more
  1. 2019Generative Modeling and Inverse Imaging of Cardiac Transmembrane Potentialcited by 6
  2. 2020Learning Geometry-Dependent and Physics-Based Inverse Image Reconstructioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Machine Learning Methods for Studying Latent Neural Activity Dynamics
  2. 2024Probabilistic Decomposed Linear Dynamical Systems for Robust Discovery of Latent Neural Dynamics
  3. 2024Diffusion-Based Generation of Neural Activity from Disentangled Latent Codes
  4. 2025State Space Models Naturally Produce Time Cell and Oscillatory Behaviors and Scale to Abstract Cognitive Functions
  5. 2026Observable Neural ODEs for Identifiable Causal Forecasting in Continuous Time
  6. 2022Interpretable Latent Variables in Deep State Space Models
  7. 2024Deep Learning-based Approaches for State Space Models: A Selective Review
  8. 2025Learning Local Causal World Models with State Space Models and Attention