mlsanityData to 14 Oct 2026

Transfer Learning for High-dimensional Reduced Rank Time Series Models

arXiv 2504.15691 ↗First posted 22 Apr 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The objective of transfer learning is to enhance estimation and inference in a target data by leveraging knowledge gained from additional sources. Recent studies have explored transfer learning for independent observations in complex, high-dimensional models assuming sparsity, yet research on time series models remains limited. Our focus is on transfer learning for sequences of observations with temporal dependencies and a more intricate model parameter structure. Specifically, we investigate the vector autoregressive model (VAR), a widely recognized model for time series data, where the transition matrix can be deconstructed into a combination of a sparse matrix and a low-rank one. We propose a new transfer learning algorithm tailored for estimating high-dimensional VAR models characterized by low-rank and sparse structures. Additionally, we present a novel approach for selecting informative observations from auxiliary datasets. Theoretical guarantees are established, encompassing model parameter consistency, informative set selection, and the asymptotic distribution of estimators under mild conditions. The latter facilitates the construction of entry-wise confidence intervals for model parameters. Finally, we demonstrate the empirical efficacy of our methodologies through both simulated and real-world datasets.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 33 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

14 of 33 references.

References · 14

  1. 2020Provable Meta-Learning of Linear Representationscited by 161
  2. 2020A Survey on Negative Transfercited by 122
  3. 2020Transfer Learning for High-dimensional Linear Regression: Prediction, Estimation, and Minimax Optimalitycited by 90
  4. 2013Confidence Intervals and Hypothesis Testing for High-Dimensional Regressioncited by 79
  5. 2021Transfer Learning under High-dimensional Generalized Linear Modelscited by 70
  6. 2019Transfer Learning for Nonparametric Classification: Minimax Rate and Adaptive Classifiercited by 65
  7. 2013Regularized estimation in sparse high-dimensional time series modelscited by 41
  8. 2020Transfer Learning in Large-scale Gaussian Graphical Models with False Discovery Rate Controlcited by 38
  9. 2023Learning from Similar Linear Representations: Adaptivity, Minimaxity, and Robustnesscited by 28
  10. 2014Fast Rates by Transferring from Auxiliary Hypothesescited by 16
  11. 2019Online Debiasing for Adaptively Collected High-dimensional Data with Applications to Time Series Analysiscited by 13
  12. 2016Estimating Structured Vector Autoregressive Modelcited by 10
2 more
  1. 2024Smoothness Adaptive Hypothesis Transfer Learningcited by 8
  2. 2023Hypothesis Transfer Learning with Surrogate Classification Losses: Generalization Bounds through Algorithmic Stabilitycited by 4

Built on by

Not cited yet.