# Independent Innovation Analysis for Nonlinear Vector Autoregressive Process

arXiv: https://arxiv.org/abs/2006.10944 · HTML: https://mlsanity.com/paper/2006.10944/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 19 Jun 2020.

## Built on by (most cited first, 19 of 19)

- [Disentangling Identifiable Features from Noisy Data with Structured Nonlinear ICA](https://mlsanity.com/paper/2106.09620/) (2021)
- [Identifiability of latent-variable and structural-equation models: from linear to nonlinear](https://mlsanity.com/paper/2302.02672/) (2023)
- [Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learning](https://mlsanity.com/paper/2303.16535/) (2023)
- [Causal Representation Learning Made Identifiable by Grouping of Observational Variables](https://mlsanity.com/paper/2310.15709/) (2023)
- [Cross-Entropy Is All You Need To Invert the Data Generating Process](https://mlsanity.com/paper/2410.21869/) (2024)
- [Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning](https://mlsanity.com/paper/2406.14302/) (2024)
- [From superposition to sparse codes: interpretable representations in neural networks](https://mlsanity.com/paper/2503.01824/) (2025)
- [On the Identifiability of Switching Dynamical Systems](https://mlsanity.com/paper/2305.15925/) (2023)
- [An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis](https://mlsanity.com/paper/2311.18048/) (2023)
- [Position: An Empirically Grounded Identifiability Theory Will Accelerate Self-Supervised Learning Research](https://mlsanity.com/paper/2504.13101/) (2025)
- [From latent dynamics to meaningful representations](https://mlsanity.com/paper/2209.00905/) (2022)
- [Skill Learning via Policy Diversity Yields Identifiable Representations for Reinforcement Learning](https://mlsanity.com/paper/2507.14748/) (2025)
- [Explainable nonlinear modelling of multiple time series with invertible neural networks](https://mlsanity.com/paper/2107.00391/) (2021)
- [Leveraging Task Structures for Improved Identifiability in Neural Network Representations](https://mlsanity.com/paper/2306.14861/) (2023)
- [End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems](https://mlsanity.com/paper/2605.06315/) (2026)
- [Identifying latent state transition in non-linear dynamical systems](https://mlsanity.com/paper/2406.03337/) (2024)
- [Estimating Treatment Effects with Independent Component Analysis](https://mlsanity.com/paper/2507.16467/) (2025)
- [Independent Component Discovery in Temporal Count Data](https://mlsanity.com/paper/2601.21696/) (2026)
- [Causal Representation Learning with Instantaneous and Lagged Relations via Nonstationarity](https://mlsanity.com/paper/2610.03452/) (2026)

## Abstract (arXiv)

The nonlinear vector autoregressive (NVAR) model provides an appealing framework to analyze multivariate time series obtained from a nonlinear dynamical system. However, the innovation (or error), which plays a key role by driving the dynamics, is almost always assumed to be additive. Additivity greatly limits the generality of the model, hindering analysis of general NVAR processes which have nonlinear interactions between the innovations. Here, we propose a new general framework called independent innovation analysis (IIA), which estimates the innovations from completely general NVAR. We assume mutual independence of the innovations as well as their modulation by an auxiliary variable (which is often taken as the time index and simply interpreted as nonstationarity). We show that IIA guarantees the identifiability of the innovations with arbitrary nonlinearities, up to a permutation and component-wise invertible nonlinearities. We also propose three estimation frameworks depending on the type of the auxiliary variable. We thus provide the first rigorous identifiability result for general NVAR, as well as very general tools for learning such models.