When AI Generates Covariates: Causal Typing and Estimand Drift in Sequential Experiments
Not on the map. Why?
Abstract (arXiv)
AI-generated covariates from notes, conversations, images, and wearable streams can change the causal question when their roles are left unspecified. A generated feature may represent a treatment version, pre-action state, history, design variable, mediator, outcome proxy, observation process, or intercurrent event; these roles are not interchangeable. We formulate a causal type discipline for sequential experiments: a versioned representation map, a causal role classifier, a claim-status filter, and an estimand lock. The lock fixes a standardized proximal effect before generated covariates enter the analysis. Under audit correctness and standard identification assumptions, admissible role assignments preserve this estimand. We apply the established conditional-covariance characterization of compression bias to substitution of generated representations for design-relevant states. A standardized decomposition separates compression, conditional-law, and standardization drift. Further results cover mediator adjustment, post-action leakage, marker-intervention conflation, outcome-guided discovery, and state-measurement error. Cluster-level orthogonal estimators distinguish empirical and superpopulation targets under repeated sessions and missing outcomes. Simulations show that refinement helps when it retains design-relevant information, whereas design erasure, leakage, and same-data marker selection can produce bias or undercoverage. The framework places causal semantics and claim status before confirmatory inference with generated representations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 54 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
16 of 54 references.
References · 16
- 2016Learning Representations for Counterfactual Inferencecited by 329
- 2023Prediction-Powered Inferencecited by 220
- 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 178
- 2016Identifying Causal Effects With Proxy Variables of an Unmeasured Confoundercited by 139
- 2013Exact post-selection inference, with application to the lassocited by 91
- 2018How to Make Causal Inferences Using Textscited by 59
- 2020Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimatescited by 59
- 2017Using simulation studies to evaluate statistical methodscited by 49
- 2016Assessing Time-Varying Causal Effect Moderation in Mobile Healthcited by 27
- 2015Structural Nested Models and G-estimation: The Partially Realized Promisecited by 15
- 2022Conceptualizing Treatment Leakage in Text-based Causal Inferencecited by 14
- 2024Inference for Regression with Variables Generated by AI or Machine Learningcited by 12
4 more
- 2021The Micro-Randomized Trial for Developing Digital Interventions: Experimental Design and Data Analysis Considerationscited by 11
- 2021Deconfounding Scores: Feature Representations for Causal Effect Estimation with Weak Overlapcited by 9
- 2019Estimating Time-Varying Causal Excursion Effect in Mobile Health with Binary Outcomescited by 6
- 2026Deconfounding Scores and Representation Learning for Causal Effect Estimation with Weak Overlapcited by 2
Built on by
Not cited yet.