Optimal Algorithms for Testing Closeness of Discrete Distributions
Not on the map. Why?
Abstract (arXiv)
We study the question of closeness testing for two discrete distributions. More precisely, given samples from two distributions p and q over an n-element set, we wish to distinguish whether p=q versus p is at least eps-far from q, in either ℓ1 or ℓ2 distance. Batu et al. gave the first sub-linear time algorithms for these problems, which matched the lower bounds of Valiant up to a logarithmic factor in n, and a polynomial factor of eps. In this work, we present simple (and new) testers for both the ℓ1 and ℓ2 settings, with sample complexity that is information-theoretically optimal, to constant factors, both in the dependence on n, and the dependence on eps; for the ℓ1 testing problem we establish that the sample complexity is Theta(maxn2/3/eps4/3, n1/2/eps2 ).
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Aug 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 6; 2024: 6; 2025: 7; 2026: 5.
37 papers.
Sort:
- 2021Exponential separations between learning with and without quantum memorycited by 50
- 2021The Price of Tolerance in Distribution Testingcited by 13
- 2022Byzantine-Robust Online and Offline Distributed Reinforcement Learningcited by 13
- 2023Testing Closeness of Multivariate Distributions via Ramsey Theorycited by 8
- 2024An Auditing Test To Detect Behavioral Shift in Language Modelscited by 8
- 2021Robust Testing and Estimation under Manipulation Attackscited by 5
- 2022Near-Optimal Bounds for Testing Histogram Distributionscited by 4
- 2022Complexity of High-Dimensional Identity Testing with Coordinate Conditional Samplingcited by 4
- 2024Replicable Uniformity Testingcited by 4
- 2021F-Divergences and Cost Function Locality in Generative Modelling with Quantum Circuitscited by 3
- 2022Gaussian Mean Testing Made Simplecited by 3
- 2023Sample-Efficient Learning of POMDPs with Multiple Observations In Hindsightcited by 3
25 more
- 2022Sub-quadratic Algorithms for Kernel Matrices via Kernel Density Estimationcited by 2
- 2023Uniformity Testing over Hypergrids with Subcube Conditioningcited by 2
- 2024Optimal Algorithms for Augmented Testing of Discrete Distributionscited by 2
- 2025Bias Detection via Maximum Subgroup Discrepancycited by 2
- 2025Replicable Distribution Testingcited by 2
- 2022Sharp Constants in Uniformity Testing via the Huber Statisticcited by 1
- 2022Mathematical Framework for Online Social Media Auditingcited by 1
- 2023Testing High-dimensional Multinomials with Applications to Text Analysiscited by 1
- 2023Testing with Non-identically Distributed Samplescited by 1
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2025Instance-Optimal Uniformity Testing and Trackingcited by 1
- 2026Optimal Prediction-Augmented Algorithms for Testing Independence of Distributionscited by 1
- 2026Total Variation Distance Estimation in Autoregressive Modelscited by 1
- 2021Uniformity Testing in the Shuffle Model: Simpler, Better, Fastercited by 0
- 2021As Easy as ABC: Adaptive Binning Coincidence Test for Uniformity Testingcited by 0
- 2023The Minimax Risk in Testing Uniformity over Large Alphabets under Missing-Ball Alternativescited by 0
- 2024Membership Testing in Markov Equivalence Classes via Independence Query Oraclescited by 0
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regressioncited by 0
- 2025Optimal structure learning and conditional independence testingcited by 0
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approachcited by 0
- 2025Non-iid hypothesis testing: from classical to quantumcited by 0
- 2025A Distribution Testing Approach to Clustering Distributionscited by 0
- 2026When Are Trade-Off Functions Testable from Finite Samples?cited by 0
- 2026Entropy Equivalence Testingcited by 0
- 2026The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capabilitycited by 0
- 2026The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capability7 Sep 2026
- 2026Total Variation Distance Estimation in Autoregressive Models21 Jul 2026
- 2026Entropy Equivalence Testing22 May 2026
- 2026When Are Trade-Off Functions Testable from Finite Samples?11 May 2026
- 2026Optimal Prediction-Augmented Algorithms for Testing Independence of Distributions4 Mar 2026
- 2025A Distribution Testing Approach to Clustering Distributions9 Dec 2025
- 2025Non-iid hypothesis testing: from classical to quantum7 Oct 2025
- 2025Instance-Optimal Uniformity Testing and Tracking4 Aug 2025
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approach17 Jul 2025
- 2025Optimal structure learning and conditional independence testing8 Jul 2025
- 2025Replicable Distribution Testing3 Jul 2025
- 2025Bias Detection via Maximum Subgroup Discrepancy4 Feb 2025
25 more
- 2024Optimal Algorithms for Augmented Testing of Discrete Distributions1 Dec 2024
- 2024An Auditing Test To Detect Behavioral Shift in Language Models25 Oct 2024
- 2024Replicable Uniformity Testing12 Oct 2024
- 2024Testing Credibility of Public and Private Surveys through the Lens of Regression7 Oct 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2024Membership Testing in Markov Equivalence Classes via Independence Query Oracles9 Mar 2024
- 2023Testing Closeness of Multivariate Distributions via Ramsey Theory22 Nov 2023
- 2023Testing with Non-identically Distributed Samples19 Nov 2023
- 2023Sample-Efficient Learning of POMDPs with Multiple Observations In Hindsight6 Jul 2023
- 2023The Minimax Risk in Testing Uniformity over Large Alphabets under Missing-Ball Alternatives29 May 2023
- 2023Uniformity Testing over Hypergrids with Subcube Conditioning17 Feb 2023
- 2023Testing High-dimensional Multinomials with Applications to Text Analysis3 Jan 2023
- 2022Sub-quadratic Algorithms for Kernel Matrices via Kernel Density Estimation1 Dec 2022
- 2022Gaussian Mean Testing Made Simple25 Oct 2022
- 2022Mathematical Framework for Online Social Media Auditing12 Sep 2022
- 2022Complexity of High-Dimensional Identity Testing with Coordinate Conditional Sampling19 Jul 2022
- 2022Near-Optimal Bounds for Testing Histogram Distributions14 Jul 2022
- 2022Sharp Constants in Uniformity Testing via the Huber Statistic21 Jun 2022
- 2022Byzantine-Robust Online and Offline Distributed Reinforcement Learning1 Jun 2022
- 2021Exponential separations between learning with and without quantum memory10 Nov 2021
- 2021As Easy as ABC: Adaptive Binning Coincidence Test for Uniformity Testing12 Oct 2021
- 2021F-Divergences and Cost Function Locality in Generative Modelling with Quantum Circuits8 Oct 2021
- 2021Uniformity Testing in the Shuffle Model: Simpler, Better, Faster20 Aug 2021
- 2021The Price of Tolerance in Distribution Testing25 Jun 2021
- 2021Robust Testing and Estimation under Manipulation Attacks21 Apr 2021
- 2021Exponential separations between learning with and without quantum memorycited by 50
- 2021The Price of Tolerance in Distribution Testingcited by 13
- 2022Byzantine-Robust Online and Offline Distributed Reinforcement Learningcited by 13
- 2023Testing Closeness of Multivariate Distributions via Ramsey Theorycited by 8
- 2024An Auditing Test To Detect Behavioral Shift in Language Modelscited by 8
- 2021Robust Testing and Estimation under Manipulation Attackscited by 5
- 2022Near-Optimal Bounds for Testing Histogram Distributionscited by 4
- 2022Complexity of High-Dimensional Identity Testing with Coordinate Conditional Samplingcited by 4
- 2024Replicable Uniformity Testingcited by 4
- 2021F-Divergences and Cost Function Locality in Generative Modelling with Quantum Circuitscited by 3
- 2022Gaussian Mean Testing Made Simplecited by 3
- 2023Sample-Efficient Learning of POMDPs with Multiple Observations In Hindsightcited by 3
12 most cited of 37 All 37 (JSON)
- 2026The Oversight Gap: What LLM Safety Monitors Miss, and Why It Is Not Capability7 Sep 2026
- 2026Total Variation Distance Estimation in Autoregressive Models21 Jul 2026
- 2026Entropy Equivalence Testing22 May 2026
- 2026When Are Trade-Off Functions Testable from Finite Samples?11 May 2026
- 2026Optimal Prediction-Augmented Algorithms for Testing Independence of Distributions4 Mar 2026
- 2025A Distribution Testing Approach to Clustering Distributions9 Dec 2025
- 2025Non-iid hypothesis testing: from classical to quantum7 Oct 2025
- 2025Instance-Optimal Uniformity Testing and Tracking4 Aug 2025
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approach17 Jul 2025
- 2025Optimal structure learning and conditional independence testing8 Jul 2025
- 2025Replicable Distribution Testing3 Jul 2025
- 2025Bias Detection via Maximum Subgroup Discrepancy4 Feb 2025
12 newest of 37 All 37 (JSON)