Near optimal finite time identification of arbitrary linear dynamical systems
Not on the map. Why?
Abstract (arXiv)
We derive finite time error bounds for estimating general linear time-invariant (LTI) systems from a single observed trajectory using the method of least squares. We provide the first analysis of the general case when eigenvalues of the LTI system are arbitrarily distributed in three regimes: stable, marginally stable, and explosive. Our analysis yields sharp upper bounds for each of these cases separately. We observe that although the underlying process behaves quite differently in each of these three regimes, the systematic analysis of a self--normalized martingale difference term helps bound identification error up to logarithmic factors of the lower bound. On the other hand, we demonstrate that the least squares solution may be statistically inconsistent under certain conditions even when the signal-to-noise ratio is high.
Key facts. Cited by 89 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 19; 2023: 20; 2024: 12; 2025: 11; 2026: 9.
89 papers.
Sort:
- 2023Transformers as Algorithms: Generalization and Stability in In-context Learningcited by 222
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 53
- 2021First-Order Regret in Reinforcement Learning with Linear Function Approximation: A Robust Estimation Approachcited by 38
- 2024From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformerscited by 34
- 2022Learning with little mixingcited by 33
- 2022Single Trajectory Nonparametric Learning of Nonlinear Dynamicscited by 26
- 2023A Tutorial on the Non-Asymptotic Theory of System Identificationcited by 26
- 2023A New Approach to Learning Linear Dynamical Systemscited by 23
- 2021Linear Systems can be Hard to Learncited by 20
- 2021Streaming Linear System Identification with Reverse Experience Replaycited by 17
- 2021Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systemscited by 17
- 2022FedSysID: A Federated Approach to Sample-Efficient System Identificationcited by 17
38 more
- 2021Joint Learning of Linear Time-Invariant Dynamical Systemscited by 16
- 2021Task-Optimal Exploration in Linear Dynamical Systemscited by 15
- 2022Learning Mixtures of Linear Dynamical Systemscited by 15
- 2022Identifying the Dynamics of a System by Leveraging Data from Similar Systemscited by 15
- 2021Identification and Adaptive Control of Markov Jump Systems: Sample Complexity and Regret Boundscited by 14
- 2023Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregressioncited by 14
- 2022Finite Sample Identification of Bilinear Dynamical Systemscited by 12
- 2022Regret Lower Bounds for Learning Linear Quadratic Gaussian Systemscited by 11
- 2022Learning to Control Linear Systems can be Hardcited by 11
- 2023Learning Personalized Models with Clustered System Identificationcited by 11
- 2023Tensor Decompositions Meet Control Theory: Learning General Mixtures of Linear Dynamical Systemscited by 10
- 2024Sharp Rates in Dependent Learning Theory: Avoiding Sample Size Deflation for the Square Losscited by 10
- 2021Learning from Censored and Dependent Data: The case of Linear Dynamicscited by 9
- 2021Sparsity in Partially Controllable Linear Systemscited by 9
- 2023An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysiscited by 9
- 2022Learning the Dynamics of Autonomous Linear Systems From Multiple Trajectoriescited by 8
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systemscited by 8
- 2021On the Sample Complexity of Decentralized Linear Quadratic Regulator with Partially Nested Information Structurecited by 7
- 2021Regret Analysis of Distributed Online LQR Control for Unknown LTI Systemscited by 6
- 2023The noise level in linear regression with dependent datacited by 6
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysiscited by 6
- 2024Learning Linear Dynamics from Bilinear Observationscited by 6
- 2023Learning linear dynamical systems under convex constraintscited by 5
- 2023Non-asymptotic System Identification for Linear Systems with Nonlinear Policiescited by 5
- 2025Finite Sample Identification of Partially Observed Bilinear Dynamical Systemscited by 5
- 2025Universal Learning of Nonlinear Dynamicscited by 5
- 2021Robust Online Control with Model Misspecificationcited by 4
- 2021Time varying regression with hidden linear dynamicscited by 4
- 2022Fairness in Forecasting of Observations of Linear Dynamical Systemscited by 4
- 2023Non-Asymptotic Pointwise and Worst-Case Bounds for Classical Spectrum Estimatorscited by 4
- 2021Certainty Equivalent Quadratic Control for Markov Jump Systemscited by 3
- 2021Non asymptotic estimation lower bounds for LTI state space models with Cram'er-Rao and van Treescited by 3
- 2022Joint Learning-Based Stabilization of Multiple Unknown Linear Systemscited by 3
- 2022Finite-sample analysis of identification of switched linear systems with arbitrary or restricted switchingcited by 3
- 2022Distributed Online System Identification for LTI Systems Using Reverse Experience Replaycited by 3
- 2023Learning Linearized Models from Nonlinear Systems with Finite Datacited by 3
- 2024Combining Federated Learning and Control: A Surveycited by 3
- 2024Sample Complexity Bounds for Linear System Identification from a Finite Setcited by 3
50 most cited of 89 All 89 (JSON)
- 2026Learning Fractional-Order Dynamics from a Single Trajectory16 Sep 2026
- 2026Adaptive Symmetry Discovery for Dynamical System Identification8 Aug 2026
- 2026Spectral Distillation: From Nonlinear Dynamics to Linear State-Space Models5 Aug 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Limits of Learning Linear Dynamics from Experiments12 May 2026
- 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression2 May 2026
- 2026CLT-Optimal Parameter Error Bounds for Linear System Identification23 Apr 2026
- 2026Optimal Centered Active Excitation in Linear System Identification7 Apr 2026
- 2026Achieving widetildeO(1/ε) Sample Complexity for Bilinear Systems Identification under Bounded Noises21 Mar 2026
- 2025Symmetric Linear Dynamical Systems are Learnable from Few Observations5 Dec 2025
- 2025High Effort, Low Gain: Fundamental Limits of Active Learning for Linear Dynamical Systems15 Sep 2025
- 2025Frequency Response Identification of Low-Order Systems: Finite-Sample Analysis23 Aug 2025
38 more
- 2025Federated Nonlinear System Identification20 Aug 2025
- 2025Universal Learning of Nonlinear Dynamics16 Aug 2025
- 2025Learning Linearized Models from Nonlinear Systems under Initialization Constraints with Finite Data8 May 2025
- 2025Temporal Robustness in Discrete Time Linear Dynamical Systems5 May 2025
- 2025Learning Stabilizing Policies via an Unstable Subspace Representation2 May 2025
- 2025Boosting-Enabled Robust System Identification of Partially Observed LTI Systems Under Heavy-Tailed Noise25 Apr 2025
- 2025A New Approach to Controlling Linear Dynamical Systems4 Apr 2025
- 2025Finite Sample Identification of Partially Observed Bilinear Dynamical Systems13 Jan 2025
- 2024Long-Context Linear System Identification8 Oct 2024
- 2024End-to-end guarantees for indirect data-driven control of bilinear systems with finite stochastic data26 Sep 2024
- 2024Learning Linear Dynamics from Bilinear Observations24 Sep 2024
- 2024On the Effect of Instability on Learning Continuous-Time Linear Control Systems17 Sep 2024
- 2024Sample Complexity Bounds for Linear System Identification from a Finite Set17 Sep 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Joint Learning of Linear Dynamical Systems under Smoothness Constraints3 Jun 2024
- 2024Learning to Stabilize Unknown LTI Systems on a Single Trajectory under Stochastic Noise31 May 2024
- 2024Learning Low-dimensional Latent Dynamics from High-dimensional Observations: Non-asymptotics and Lower Bounds9 May 2024
- 2024A least-square method for non-asymptotic identification in linear switching control11 Apr 2024
- 2024From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers21 Feb 2024
- 2024Sharp Rates in Dependent Learning Theory: Avoiding Sample Size Deflation for the Square Loss8 Feb 2024
- 2023An Interventional Perspective on Identifiability in Gaussian LTI Systems with Independent Component Analysis29 Nov 2023
- 2023Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression17 Oct 2023
- 2023From Spectral Theorem to Statistical Independence with Application to System Identification16 Oct 2023
- 2023Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbances4 Oct 2023
- 2023Learning the Uncertainty Sets for Control Dynamics via Set Membership: A Non-Asymptotic Analysis26 Sep 2023
- 2023Learning Linearized Models from Nonlinear Systems with Finite Data15 Sep 2023
- 2023A Tutorial on the Non-Asymptotic Theory of System Identification7 Sep 2023
- 2023Tensor Decompositions Meet Control Theory: Learning General Mixtures of Linear Dynamical Systems13 Jul 2023
- 2023Non-asymptotic System Identification for Linear Systems with Nonlinear Policies17 Jun 2023
- 2023SAMoSSA: Multivariate Singular Spectrum Analysis with Stochastic Autoregressive Noise25 May 2023
- 2023The noise level in linear regression with dependent data18 May 2023
- 2023Generalization for slowly mixing processes28 Apr 2023
- 2023Learning and Concentration for High Dimensional Linear Gaussians: an Invariant Subspace Approach4 Apr 2023
- 2023Learning Personalized Models with Clustered System Identification3 Apr 2023
- 2023Learning linear dynamical systems under convex constraints27 Mar 2023
- 2023Non-Asymptotic Pointwise and Worst-Case Bounds for Classical Spectrum Estimators21 Mar 2023
- 2023Learning Dynamical Systems by Leveraging Data from Similar Systems8 Feb 2023
- 2023A New Approach to Learning Linear Dynamical Systems23 Jan 2023
50 newest of 89 All 89 (JSON)
- 2023Transformers as Algorithms: Generalization and Stability in In-context Learningcited by 222
- 2022Statistical Learning Theory for Control: A Finite Sample Perspectivecited by 53
- 2021First-Order Regret in Reinforcement Learning with Linear Function Approximation: A Robust Estimation Approachcited by 38
- 2024From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformerscited by 34
- 2022Learning with little mixingcited by 33
- 2022Single Trajectory Nonparametric Learning of Nonlinear Dynamicscited by 26
- 2023A Tutorial on the Non-Asymptotic Theory of System Identificationcited by 26
- 2023A New Approach to Learning Linear Dynamical Systemscited by 23
- 2021Linear Systems can be Hard to Learncited by 20
- 2021Streaming Linear System Identification with Reverse Experience Replaycited by 17
- 2021Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systemscited by 17
- 2022FedSysID: A Federated Approach to Sample-Efficient System Identificationcited by 17
12 most cited of 89 All 89 (JSON)
- 2026Learning Fractional-Order Dynamics from a Single Trajectory16 Sep 2026
- 2026Adaptive Symmetry Discovery for Dynamical System Identification8 Aug 2026
- 2026Spectral Distillation: From Nonlinear Dynamics to Linear State-Space Models5 Aug 2026
- 2026A Memory Efficient Unified Algorithm for Online Learning of Linear Dynamical Systems2 Jul 2026
- 2026Limits of Learning Linear Dynamics from Experiments12 May 2026
- 2026Self-Normalized Martingales and Uniform Regret Bounds for Linear Regression2 May 2026
- 2026CLT-Optimal Parameter Error Bounds for Linear System Identification23 Apr 2026
- 2026Optimal Centered Active Excitation in Linear System Identification7 Apr 2026
- 2026Achieving widetildeO(1/ε) Sample Complexity for Bilinear Systems Identification under Bounded Noises21 Mar 2026
- 2025Symmetric Linear Dynamical Systems are Learnable from Few Observations5 Dec 2025
- 2025High Effort, Low Gain: Fundamental Limits of Active Learning for Linear Dynamical Systems15 Sep 2025
- 2025Frequency Response Identification of Low-Order Systems: Finite-Sample Analysis23 Aug 2025
12 newest of 89 All 89 (JSON)