# Cauchy combination test: a powerful test with analytic p-value calculation under arbitrary dependency structures

arXiv: https://arxiv.org/abs/1808.09011 · HTML: https://mlsanity.com/paper/1808.09011/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 27 Aug 2018.

## Built on by (most cited first, 20 of 20)

- [ViTally Consistent: Scaling Biological Representation Learning for Cell Microscopy](https://mlsanity.com/paper/2411.02572/) (2024)
- [Boosting Data Analytics With Synthetic Volume Expansion](https://mlsanity.com/paper/2310.17848/) (2023)
- [Max-Rank: Efficient Multiple Testing for Conformal Prediction](https://mlsanity.com/paper/2311.10900/) (2023)
- [SHAP-XRT: The Shapley Value Meets Conditional Independence Testing](https://mlsanity.com/paper/2207.07038/) (2022)
- [Efficient Ensemble Conditional Independence Test Framework for Causal Discovery](https://mlsanity.com/paper/2509.21021/) (2025)
- [From Conditional to Unconditional Independence: Testing Conditional Independence via Transport Maps](https://mlsanity.com/paper/2504.09567/) (2025)
- [A Two-armed Bandit Framework for A/B Testing](https://mlsanity.com/paper/2507.18118/) (2025)
- [Conformal Prediction Beyond the Horizon: Distribution-Free Inference for Policy Evaluation](https://mlsanity.com/paper/2510.26026/) (2025)
- [A Statistical Test for the Benefits of Personalizing Interventions](https://mlsanity.com/paper/2607.08951/) (2026)
- [Strategic A/B testing via Maximum Probability-driven Two-armed Bandit](https://mlsanity.com/paper/2506.22536/) (2025)
- [Enhancing Out-of-Distribution Detection with Multitesting-based Layer-wise Feature Fusion](https://mlsanity.com/paper/2403.10803/) (2024)
- [A Unified Combination Framework for Dependent Tests with Applications to Microbiome Association Studies](https://mlsanity.com/paper/2404.09353/) (2024)
- [A Two-Sample Test of Text Generation Similarity](https://mlsanity.com/paper/2505.05269/) (2025)
- [Improving Coverage in Combined Prediction Sets with Weighted p-values](https://mlsanity.com/paper/2505.11785/) (2025)
- [LLMBDC: Language Model for Biological Domains Oriented Clustering of Gene Ontology](https://mlsanity.com/paper/2608.00099/) (2026)
- [GFCM: A Tail-Sensitive Mixed-Type Conditional Independence Test for Causal Discovery](https://mlsanity.com/paper/2608.15332/) (2026)
- [What FID Hides: Detecting, Ranking, and Diagnosing Deviations in Generative Evaluation](https://mlsanity.com/paper/2608.24881/) (2026)
- [Membership Inference via Pairwise Likelihood Ratios](https://mlsanity.com/paper/2609.12367/) (2026)
- [SPARK: A General Goodness-of-Fit Assessment via Residual Projection](https://mlsanity.com/paper/2609.37705/) (2026)
- [Graph Anomaly Detection as Finite-Horizon Control: Training-Free Scoring via Empirical Bayes](https://mlsanity.com/paper/2609.38424/) (2026)

## Abstract (arXiv)

Combining individual p-values to aggregate multiple small effects has a long-standing interest in statistics, dating back to the classic Fisher's combination test. In modern large-scale data analysis, correlation and sparsity are common features and efficient computation is a necessary requirement for dealing with massive data. To overcome these challenges, we propose a new test that takes advantage of the Cauchy distribution. Our test statistic has a very simple form and is defined as a weighted sum of Cauchy transformation of individual p-values. We prove a non-asymptotic result that the tail of the null distribution of our proposed test statistic can be well approximated by a Cauchy distribution under arbitrary dependency structures. Based on this theoretical result, the p-value calculation of our proposed test is not only accurate, but also as simple as the classic z-test or t-test, making our test well suited for analyzing massive data. We further show that the power of the proposed test is asymptotically optimal in a strong sparsity setting. Extensive simulations demonstrate that the proposed test has both strong power against sparse alternatives and a good accuracy with respect to p-value calculations, especially for very small p-values. The proposed test has also been applied to a genome-wide association study of Crohn's disease and compared with several existing tests.