Exploiting Independent Instruments: Identification and Distribution Generalization
Not on the map. Why?
Abstract (arXiv)
Instrumental variable models allow us to identify a causal function between covariates X and a response Y, even in the presence of unobserved confounding. Most of the existing estimators assume that the error term in the response Y and the hidden confounders are uncorrelated with the instruments Z. This is often motivated by a graphical separation, an argument that also justifies independence. Positing an independence restriction, however, leads to strictly stronger identifiability results. We connect to the existing literature in econometrics and provide a practical method called HSIC-X for exploiting independence that can be combined with any gradient-based learning procedure. We see that even in identifiable settings, taking into account higher moments may yield better finite sample results. Furthermore, we exploit the independence for distribution generalization. We prove that the proposed estimator is invariant to distributional shifts on the instruments and worst-case optimal whenever these shifts are sufficiently strong. These results hold even in the under-identified case where the instruments are not sufficiently rich to identify the causal function.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 18 of its 53 references that are in the map. First posted on arXiv 3 Feb 2022.
Builds on
18 of 53 references.
References · 18
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Invariant Risk Minimizationcited by 1,832
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2015Causal inference using invariant prediction: identification and confidence intervalscited by 533
- 2020Environment Inference for Invariant Learningcited by 306
- 2016Foundations of Structural Causal Models with Cycles and Latent Variablescited by 134
- 2017Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributionscited by 125
- 2019Kernel Instrumental Variable Regressioncited by 118
- 2018Anchor regression: heterogeneous data meets causalitycited by 116
- 2019Deep Generalized Method of Moments for Instrumental Variable Analysiscited by 88
- 2020A causal framework for distribution generalizationcited by 68
- 2016Kernel-based Tests for Joint Independencecited by 40
6 more
- 2019Robust Learning with the Hilbert-Schmidt Independence Criterioncited by 36
- 2019Stabilizing Variable Selection and Regressioncited by 31
- 2017Nonparametric independence testing via mutual informationcited by 22
- 2020Distributional robustness of K-class estimators and the PULSEcited by 11
- 2015Invariant Models for Causal Transfer Learningcited by 4
- 2013Iterative Estimation of Solutions to Noisy Nonlinear Operator Equations in Nonparametric Instrumental Regressioncited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 5; 2024: 5; 2025: 2; 2026: 3.
18 papers.
Sort:
By area:
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2023Identifying Representations for Intervention Extrapolationcited by 21
- 2022Instrumental Variables in Causal Inference and Machine Learning: A Surveycited by 10
- 2022Identifying Causal Effects using Instrumental Time Series: Nuisance IV and Correcting for the Pastcited by 9
- 2022Identifiability of Sparse Causal Effects using Instrumental Variablescited by 9
- 2023Estimation Beyond Data Reweighting: Kernel Method of Momentscited by 5
- 2024Parameter identification in linear non-Gaussian causal models under general confoundingcited by 5
- 2023Sequential Underspecified Instrument Selection for Cause-Effect Estimationcited by 4
- 2024Targeted Sequential Indirect Experiment Designcited by 4
- 2025Achievable distributional robustness when the robust risk is only partially identifiedcited by 3
- 2023Boosted Control Functions: Distribution generalization and invariance in confounded modelscited by 2
- 2025Distributional Instrumental Variable Methodcited by 2
6 more
- 2024Geometry-Aware Instrumental Variable Regressioncited by 1
- 2024Bounding Causal Effects with Leaky Instrumentscited by 0
- 2024Estimating the Causal Effects of T Cell Receptorscited by 0
- 2026Anti-causal domain generalization: Leveraging unlabeled datacited by 0
- 2026TabCF: Distributional Control Function Estimation with Tabular Foundation Modelscited by 0
- 2026Prediction-Intervention Games and Invariant Setscited by 0
- 2026Prediction-Intervention Games and Invariant Sets16 May 2026
- 2026TabCF: Distributional Control Function Estimation with Tabular Foundation Models7 May 2026
- 2026Anti-causal domain generalization: Leveraging unlabeled data19 Feb 2026
- 2025Distributional Instrumental Variable Method11 Feb 2025
- 2025Achievable distributional robustness when the robust risk is only partially identified4 Feb 2025
- 2024Estimating the Causal Effects of T Cell Receptors18 Oct 2024
- 2024Parameter identification in linear non-Gaussian causal models under general confounding31 May 2024
- 2024Targeted Sequential Indirect Experiment Design30 May 2024
- 2024Geometry-Aware Instrumental Variable Regression19 May 2024
- 2024Bounding Causal Effects with Leaky Instruments5 Apr 2024
- 2023Boosted Control Functions: Distribution generalization and invariance in confounded models9 Oct 2023
- 2023Identifying Representations for Intervention Extrapolation6 Oct 2023
6 more
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives31 Jul 2023
- 2023Estimation Beyond Data Reweighting: Kernel Method of Moments18 May 2023
- 2023Sequential Underspecified Instrument Selection for Cause-Effect Estimation11 Feb 2023
- 2022Instrumental Variables in Causal Inference and Machine Learning: A Survey12 Dec 2022
- 2022Identifiability of Sparse Causal Effects using Instrumental Variables17 Mar 2022
- 2022Identifying Causal Effects using Instrumental Time Series: Nuisance IV and Correcting for the Past11 Mar 2022
- 2023Identifying Representations for Intervention Extrapolationcited by 21
- 2022Instrumental Variables in Causal Inference and Machine Learning: A Surveycited by 10
- 2022Identifying Causal Effects using Instrumental Time Series: Nuisance IV and Correcting for the Pastcited by 9
- 2022Identifiability of Sparse Causal Effects using Instrumental Variablescited by 9
- 2023Estimation Beyond Data Reweighting: Kernel Method of Momentscited by 5
- 2024Parameter identification in linear non-Gaussian causal models under general confoundingcited by 5
- 2023Sequential Underspecified Instrument Selection for Cause-Effect Estimationcited by 4
- 2024Targeted Sequential Indirect Experiment Designcited by 4
- 2025Achievable distributional robustness when the robust risk is only partially identifiedcited by 3
- 2023Boosted Control Functions: Distribution generalization and invariance in confounded modelscited by 2
- 2025Distributional Instrumental Variable Methodcited by 2
- 2024Geometry-Aware Instrumental Variable Regressioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026Prediction-Intervention Games and Invariant Sets16 May 2026
- 2026TabCF: Distributional Control Function Estimation with Tabular Foundation Models7 May 2026
- 2026Anti-causal domain generalization: Leveraging unlabeled data19 Feb 2026
- 2025Distributional Instrumental Variable Method11 Feb 2025
- 2025Achievable distributional robustness when the robust risk is only partially identified4 Feb 2025
- 2024Estimating the Causal Effects of T Cell Receptors18 Oct 2024
- 2024Parameter identification in linear non-Gaussian causal models under general confounding31 May 2024
- 2024Targeted Sequential Indirect Experiment Design30 May 2024
- 2024Geometry-Aware Instrumental Variable Regression19 May 2024
- 2024Bounding Causal Effects with Leaky Instruments5 Apr 2024
- 2023Boosted Control Functions: Distribution generalization and invariance in confounded models9 Oct 2023
- 2023Identifying Representations for Intervention Extrapolation6 Oct 2023
12 newest of 17 All 17 (JSON)