mlsanityData to 7 Oct 2026

Canonical correlation regression with noisy data

arXiv 2512.22697 ↗First posted 27 Dec 2025econ.EM math.ST stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

We study instrumental variable regression in data rich environments. The goal is to estimate a linear model from many noisy covariates and many noisy instruments. Our key assumption is that true covariates and true instruments are repetitive, though possibly different in nature; they each reflect a few underlying factors, however those underlying factors may be misaligned. We analyze a family of estimators based on two stage least squares with spectral regularization: canonical correlations between covariates and instruments are learned in the first stage, which are used as regressors in the second stage. As a theoretical contribution, we derive upper and lower bounds on estimation error, proving optimality of the method with noisy data. As a practical contribution, we provide guidance on which types of spectral regularization to use in different regimes.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 37 references that are in the map. First posted on arXiv 27 Dec 2025.

Builds on

8 of 37 references.

References · 8

  1. 2016Rate-Optimal Perturbation Bounds for Singular Subspaces with Applications to High-Dimensional Statisticscited by 45
  2. 2015Optimal Sup-norm Rates and Uniform Inference on Nonlinear Functionals of Nonparametric IV Regressioncited by 30
  3. 2021Causal Inference with Corrupted Data: Measurement Error, Missing Values, Discretization, and Differential Privacycited by 18
  4. 2024Spectral Representation for Causal Estimation with Hidden Confounderscited by 12
  5. 2025Nonparametric Instrumental Variable Inference with Many Weak Instrumentscited by 5
  6. 2025Demystifying Spectral Feature Learning for Instrumental Variable Regressioncited by 4
  7. 2024Canonical Correlation Analysis: reviewcited by 3
  8. 2025Inference of high-dimensional weak instrumental variable regression models without ridge-regularizationcited by 1

Built on by

Not cited yet.