On the Identifiability of Switching Dynamical Systems
Not on the map. Why?
Abstract (arXiv)
The identifiability of latent variable models has received increasing attention due to its relevance in interpretability and out-of-distribution generalisation. In this work, we study the identifiability of Switching Dynamical Systems, taking an initial step toward extending identifiability analysis to sequential latent variable models. We first prove the identifiability of Markov Switching Models, which commonly serve as the prior distribution for the continuous latent variables in Switching Dynamical Systems. We present identification conditions for first-order Markov dependency structures, whose transition distribution is parametrised via non-linear Gaussians. We then establish the identifiability of the latent variables and non-linear mappings in Switching Dynamical Systems up to affine transformations, by leveraging identifiability analysis techniques from identifiable deep latent variable models. We finally develop estimation algorithms for identifiable Switching Dynamical Systems. Throughout empirical studies, we demonstrate the practicality of identifiable Switching Dynamical Systems for segmenting high-dimensional time series such as videos, and showcase the use of identifiable Markov Switching Models for regime-dependent causal discovery in climate data.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 25 May 2023.
Builds on
30 of 67 references.
References · 30
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 745
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2017Stochastic Variational Video Predictioncited by 234
- 2020DYNOTEARS: Structure Learning from Time-Series Datacited by 198
- 2021Disentanglement via Mechanism Sparsity Regularization: A New Principle for Nonlinear ICAcited by 158
18 more
- 2020Towards Nonlinear Disentanglement in Natural Data with Temporal Sparse Codingcited by 121
- 2018Disentangled Sequential Autoencodercited by 117
- 2016Composing graphical models with neural networks for structured representations and fast inferencecited by 113
- 2017A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learningcited by 107
- 2021Learning Temporally Causal Latent Processes from General Temporal Datacited by 96
- 2017Filtering Variational Objectivescited by 91
- 2020Hidden Markov Nonlinear ICA: Unsupervised Learning from Nonstationary Time Seriescited by 76
- 2022Identifiability of deep generative models without auxiliary informationcited by 70
- 2021Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICAcited by 64
- 2022Temporally Disentangled Representation Learningcited by 59
- 2022Causal Representation Learning for Instantaneous and Temporal Effects in Interactive Systemscited by 50
- 2021Clockwork Variational Autoencoderscited by 40
- 2016Recurrent switching linear dynamical systemscited by 34
- 2022Rhino: Deep Causal Temporal Relationship Learning With History-dependent Noisecited by 30
- 2020Reconstructing regime-dependent causal relationships from observational time seriescited by 28
- 2019Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systemscited by 26
- 2020Independent Innovation Analysis for Nonlinear Vector Autoregressive Processcited by 18
- 2021Deep Explicit Duration Switching Models for Time Seriescited by 17
Built on by
Citing papers per year: 2024: 4; 2025: 2; 2026: 3.
9 papers.
- 2024Marrying Causal Representation Learning with Dynamical Systems for Sciencecited by 22
- 2024Causal Temporal Representation Learning with Nonstationary Sparse Transitioncited by 12
- 2024Self-supervised contrastive learning performs non-linear system identificationcited by 9
- 2026Interventional Time Series Priors for Causal Foundation Modelscited by 6
- 2025Structure is information: structural identifiability mappings for machine learning with partially observed dynamical systemscited by 4
- 2025Flow based approach for Dynamic Temporal Causal models with non-Gaussian or Heteroscedastic Noisescited by 2
- 2024Identifying Nonstationary Causal Structures with High-Order Markov Switching Modelscited by 1
- 2026End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systemscited by 1
- 2026Identifiable Markov Switching Models with Instantaneous Effects and Exponential Familiescited by 0
- 2026Identifiable Markov Switching Models with Instantaneous Effects and Exponential Families1 Jun 2026
- 2026End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems7 May 2026
- 2026Interventional Time Series Priors for Causal Foundation Models11 Mar 2026
- 2025Flow based approach for Dynamic Temporal Causal models with non-Gaussian or Heteroscedastic Noises20 Jun 2025
- 2025Structure is information: structural identifiability mappings for machine learning with partially observed dynamical systems6 Feb 2025
- 2024Self-supervised contrastive learning performs non-linear system identification18 Oct 2024
- 2024Causal Temporal Representation Learning with Nonstationary Sparse Transition5 Sep 2024
- 2024Identifying Nonstationary Causal Structures with High-Order Markov Switching Models25 Jun 2024
- 2024Marrying Causal Representation Learning with Dynamical Systems for Science22 May 2024