Testing for arbitrary interference on experimentation platforms
Not on the map. Why?
Abstract (arXiv)
Experimentation platforms are essential to modern large technology companies, as they are used to carry out many randomized experiments daily. The classic assumption of no interference among users, under which the outcome of one user does not depend on the treatment assigned to other users, is rarely tenable on such platforms. Here, we introduce an experimental design strategy for testing whether this assumption holds. Our approach is in the spirit of the Durbin-Wu-Hausman test for endogeneity in econometrics, where multiple estimators return the same estimate if and only if the null hypothesis holds. The design that we introduce makes no assumptions on the interference model between units, nor on the network among the units, and has a sharp bound on the variance and an implied analytical bound on the type I error rate. We discuss how to apply the proposed design strategy to large experimentation platforms, and we illustrate it in the context of an experiment on the LinkedIn platform.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 4.
8 papers.
- 2023Causal Message Passing for Experiments with Unknown and General Network Interferencecited by 7
- 2024Graph Machine Learning based Doubly Robust Estimator for Network Causal Effectscited by 4
- 2023A Two-Part Machine Learning Approach to Characterizing Network Interference in A/B Testingcited by 3
- 2024Causal Inference with Complex Treatments: A Surveycited by 3
- 2022Network Synthetic Interventions: A Causal Framework for Panel Data Under Network Interferencecited by 2
- 2024Cascade-based Randomization for Inferring Causal Effects under Diffusion Interferencecited by 2
- 2023Near-Optimal Experimental Design Under the Budget Constraint in Online Platformscited by 0
- 2024A/B testing under Interference with Partial Network Informationcited by 0
- 2024Causal Inference with Complex Treatments: A Survey19 Jul 2024
- 2024Cascade-based Randomization for Inferring Causal Effects under Diffusion Interference20 May 2024
- 2024A/B testing under Interference with Partial Network Information16 Apr 2024
- 2024Graph Machine Learning based Doubly Robust Estimator for Network Causal Effects17 Mar 2024
- 2023Causal Message Passing for Experiments with Unknown and General Network Interference14 Nov 2023
- 2023A Two-Part Machine Learning Approach to Characterizing Network Interference in A/B Testing18 Aug 2023
- 2023Near-Optimal Experimental Design Under the Budget Constraint in Online Platforms10 Feb 2023
- 2022Network Synthetic Interventions: A Causal Framework for Panel Data Under Network Interference20 Oct 2022