mlsanityData to 14 Oct 2026

Outcome-Aware Spectral Feature Learning for Instrumental Variable Regression

arXiv 2512.00919 ↗First posted 30 Nov 2025stat.ML cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We address the problem of causal effect estimation in the presence of hidden confounders using nonparametric instrumental variable (IV) regression. An established approach is to use estimators based on learned spectral features, that is, features spanning the top singular subspaces of the operator linking treatments to instruments. While powerful, such features are agnostic to the outcome variable. Consequently, the method can fail when the true causal function is poorly represented by these dominant singular functions. To mitigate, we introduce Augmented Spectral Feature Learning, a framework that makes the feature learning process outcome-aware. Our method learns features by minimizing a novel contrastive loss derived from an augmented operator that incorporates information from the outcome. By learning these task-specific features, our approach remains effective even under spectral misalignment. We provide a theoretical analysis of this framework and validate our approach on challenging benchmarks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 44 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

27 of 44 references.

References · 27

  1. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  2. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  3. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  4. 2015An Introduction to Matrix Concentration Inequalitiescited by 397
  5. 2019Kernel Instrumental Variable Regressioncited by 118
  6. 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 100
  7. 2020Minimax Estimation of Conditional Moment Modelscited by 83
  8. 2020Learning Deep Features in Instrumental Variable Regressioncited by 66
  9. 2018Evaluating Reinforcement Learning Algorithms in Observational Health Settingscited by 60
  10. 2021Deep Proxy Causal Learning and its Application to Confounded Bandit Policy Evaluationcited by 40
  11. 2018Adversarial Generalized Method of Momentscited by 34
  12. 2020Provably Efficient Neural Estimation of Structural Equation Model: An Adversarial Approachcited by 31
15 more
  1. 2015Optimal Sup-norm Rates and Uniform Inference on Nonlinear Functionals of Nonparametric IV Regressioncited by 30
  2. 2021On Instrumental Variable Regression for Deep Offline Policy Evaluationcited by 22
  3. 2024Functional Bilevel Optimization for Machine Learningcited by 20
  4. 2024Neural Conditional Probability for Uncertainty Quantificationcited by 14
  5. 2023Minimax Instrumental Variable Regression and L2 Convergence Guarantees without Identification or Closednesscited by 13
  6. 2022Inference on Strongly Identified Functionals of Weakly Identified Functionscited by 12
  7. 2024Spectral Representation for Causal Estimation with Hidden Confounderscited by 12
  8. 2025Offline Reinforcement Learning in Large State Spaces: Algorithms and Guaranteescited by 10
  9. 2024Nonparametric Instrumental Regression via Kernel Methods is Minimax Optimalcited by 8
  10. 2025Self-Supervised Evolution Operator Learning for High-Dimensional Dynamical Systemscited by 7
  11. 2022Fast Instrument Learning with Faster Ratescited by 6
  12. 2025Nonparametric Instrumental Variable Regression with Observed Covariatescited by 5
  13. 2024Primal-Dual Spectral Representation for Off-policy Evaluationcited by 4
  14. 2025Demystifying Spectral Feature Learning for Instrumental Variable Regressioncited by 4
  15. 2025Optimality and Adaptivity of Deep Neural Features for Instrumental Variable Regressioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.