# Regularized estimation in sparse high-dimensional time series models

arXiv: https://arxiv.org/abs/1311.4175 · HTML: https://mlsanity.com/paper/1311.4175/

## Key facts

- Cited by 41 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Nov 2013.

## Built on by (most cited first, 30 of 41)

- [Granger Causality: A Review and Recent Advances](https://mlsanity.com/paper/2105.02675/) (2021)
- [Criteria for Classifying Forecasting Methods](https://mlsanity.com/paper/2212.03523/) (2022)
- [Streaming Linear System Identification with Reverse Experience Replay](https://mlsanity.com/paper/2103.05896/) (2021)
- [Data-Driven Sample Average Approximation with Covariate Information](https://mlsanity.com/paper/2207.13554/) (2022)
- [High Dimensional Statistical Estimation under Uniformly Dithered One-bit Quantization](https://mlsanity.com/paper/2202.13157/) (2022)
- [Causal Forecasting:Generalization Bounds for Autoregressive Models](https://mlsanity.com/paper/2111.09831/) (2021)
- [Forecasting Sparse Movement Speed of Urban Road Networks with Nonstationary Temporal Matrix Factorization](https://mlsanity.com/paper/2203.10651/) (2022)
- [Learning linear dynamical systems under convex constraints](https://mlsanity.com/paper/2303.15121/) (2023)
- [Efficient and passive learning of networked dynamical systems driven by non-white exogenous inputs](https://mlsanity.com/paper/2110.00852/) (2021)
- [Benign Overfitting in Time Series Linear Models with Over-Parameterization](https://mlsanity.com/paper/2204.08369/) (2022)
- [Correlating Time Series with Interpretable Convolutional Kernels](https://mlsanity.com/paper/2409.01362/) (2024)
- [Granger Causality using Neural Networks](https://mlsanity.com/paper/2208.03703/) (2022)
- [Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs](https://mlsanity.com/paper/2308.16859/) (2023)
- [Learning Sparse High-Dimensional Matrix-Valued Graphical Models From Dependent Data](https://mlsanity.com/paper/2404.19073/) (2024)
- [Guaranteed Multidimensional Time Series Prediction via Deterministic Tensor Completion Theory](https://mlsanity.com/paper/2501.15388/) (2025)
- [Causal Discovery for Irregularly Time Series with Consistency Guarantees](https://mlsanity.com/paper/2507.03310/) (2025)
- [Causal Discovery in High-Dimensional Point Process Networks with Hidden Nodes](https://mlsanity.com/paper/2109.10947/) (2021)
- [Joint Estimation and Inference for Multi-Experiment Networks of High-Dimensional Point Processes](https://mlsanity.com/paper/2109.11634/) (2021)
- [Optimal Variable Clustering for High-Dimensional Matrix Valued Data](https://mlsanity.com/paper/2112.12909/) (2021)
- [Graph Learning from Multivariate Dependent Time Series via a Multi-Attribute Formulation](https://mlsanity.com/paper/2205.00007/) (2022)
- [Concentration inequalities for high-dimensional linear processes with dependent innovations](https://mlsanity.com/paper/2307.12395/) (2023)
- [The Variational Bayesian Inference for Network Autoregression Models](https://mlsanity.com/paper/2102.09232/) (2021)
- [Minimax Estimation of Partially-Observed Vector AutoRegressions](https://mlsanity.com/paper/2106.09327/) (2021)
- [Concentration analysis of multivariate elliptic diffusion processes](https://mlsanity.com/paper/2206.03329/) (2022)
- [An Interpretable and Efficient Infinite-Order Vector Autoregressive Model for High-Dimensional Time Series](https://mlsanity.com/paper/2209.01172/) (2022)
- [Estimation of High-Dimensional Markov-Switching VAR Models with an Approximate EM Algorithm](https://mlsanity.com/paper/2210.07456/) (2022)
- [Mining the Factor Zoo: Estimation of Latent Factor Models with Sufficient Proxies](https://mlsanity.com/paper/2212.12845/) (2022)
- [Lag selection and estimation of stable parameters for multiple autoregressive processes through convex programming](https://mlsanity.com/paper/2303.02114/) (2023)
- [Structured Estimation of Heterogeneous Time Series](https://mlsanity.com/paper/2311.08658/) (2023)
- [A VAE-based Framework for Learning Multi-Level Neural Granger-Causal Connectivity](https://mlsanity.com/paper/2402.16131/) (2024)

## Abstract (arXiv)

Many scientific and economic problems involve the analysis of high-dimensional time series datasets. However, theoretical studies in high-dimensional statistics to date rely primarily on the assumption of independent and identically distributed (i.i.d.) samples. In this work, we focus on stable Gaussian processes and investigate the theoretical properties of ℓ 1-regularized estimates in two important statistical problems in the context of high-dimensional time series: (a) stochastic regression with serially correlated errors and (b) transition matrix estimation in vector autoregressive (VAR) models. We derive nonasymptotic upper bounds on the estimation errors of the regularized estimates and establish that consistent estimation under high-dimensional scaling is possible via ℓ1-regularization for a large class of stable processes under sparsity constraints. A key technical contribution of the work is to introduce a measure of stability for stationary processes using their spectral properties that provides insight into the effect of dependence on the accuracy of the regularized estimates. With this proposed stability measure, we establish some useful deviation bounds for dependent data, which can be used to study several important regularized estimates in a time series setting.