# The Econometrics of Randomized Experiments

arXiv: https://arxiv.org/abs/1607.00698 · HTML: https://mlsanity.com/paper/1607.00698/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Jul 2016.

## Built on by (most cited first, 14 of 14)

- [The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective](https://mlsanity.com/paper/2312.15524/) (2023)
- [Policy learning "without" overlap: Pessimism and generalized empirical Bernstein's inequality](https://mlsanity.com/paper/2212.09900/) (2022)
- [The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performances](https://mlsanity.com/paper/2407.09975/) (2024)
- [The Role of Contextual Information in Best Arm Identification](https://mlsanity.com/paper/2106.14077/) (2021)
- [Practical Marketplace Optimization at Uber Using Causally-Informed Machine Learning](https://mlsanity.com/paper/2407.19078/) (2024)
- [Data-Driven Estimation of Heterogeneous Treatment Effects](https://mlsanity.com/paper/2301.06615/) (2023)
- [LLM Personas as a Substitute for Field Experiments in Method Benchmarking](https://mlsanity.com/paper/2512.21080/) (2025)
- [Measuring, Interpreting, and Improving Fairness of Algorithms using Causal Inference and Randomized Experiments](https://mlsanity.com/paper/2309.01780/) (2023)
- [Ranking by Lifts: A Cost-Benefit Approach to Large-Scale A/B Tests](https://mlsanity.com/paper/2407.01036/) (2024)
- [Honesty in Causal Forests: When It Helps and When It Hurts](https://mlsanity.com/paper/2506.13107/) (2025)
- [Modeling Covariate Transition for Efficient Estimation of Longitudinal Treatment Effects in Randomized Experiments](https://mlsanity.com/paper/2605.31443/) (2026)
- [Across-Design Uncertainty in Short Pricing Panels: Inference and Identification](https://mlsanity.com/paper/2608.21334/) (2026)
- [Research Design Tracking and Assessment for the Social Sciences](https://mlsanity.com/paper/2608.27049/) (2026)
- [Learning Choice Model Trees for Feature-Based Multi-Product Pricing: Exact Optimization and Field Evidence](https://mlsanity.com/paper/2609.16952/) (2026)

## Abstract (arXiv)

In this review, we present econometric and statistical methods for analyzing randomized experiments. For basic experiments we stress randomization-based inference as opposed to sampling-based inference. In randomization-based inference, uncertainty in estimates arises naturally from the random assignment of the treatments, rather than from hypothesized sampling from a large population. We show how this perspective relates to regression analyses for randomized experiments. We discuss the analyses of stratified, paired, and clustered randomized experiments, and we stress the general efficiency gains from stratification. We also discuss complications in randomized experiments such as non-compliance. In the presence of non-compliance we contrast intention-to-treat analyses with instrumental variables analyses allowing for general treatment effect heterogeneity. We consider in detail estimation and inference for heterogeneous treatment effects in settings with (possibly many) covariates. These methods allow researchers to explore heterogeneity by identifying subpopulations with different treatment effects while maintaining the ability to construct valid confidence intervals. We also discuss optimal assignment to treatment based on covariates in such settings. Finally, we discuss estimation and inference in experiments in settings with interactions between units, both in general network settings and in settings where the population is partitioned into groups with all interactions contained within these groups.