mlsanityData to 7 Oct 2026

On Ranking-based Tests of Independence

arXiv 2403.07464 ↗First posted 12 Mar 2024math.ST stat.ME stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper we develop a novel nonparametric framework to test the independence of two random variables X and Y with unknown respective marginals H(dx) and G(dy) and joint distribution F(dx dy), based on it Receiver Operating Characteristic (ROC) analysis and bipartite ranking. The rationale behind our approach relies on the fact that, the independence hypothesis H0 is necessarily false as soon as the optimal scoring function related to the pair of distributions (Hotimes G,; F), obtained from a bipartite ranking algorithm, has a ROC curve that deviates from the main diagonal of the unit square.We consider a wide class of rank statistics encompassing many ways of deviating from the diagonal in the ROC space to build tests of independence. Beyond its great flexibility, this new method has theoretical properties that far surpass those of its competitors. Nonasymptotic bounds for the two types of testing errors are established. From an empirical perspective, the novel procedure we promote in this paper exhibits a remarkable ability to detect small departures, of various types, from the null assumption H0, even in high dimension, as supported by the numerical experiments presented here.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 75 references that are in the map. First posted on arXiv 12 Mar 2024.

Builds on

10 of 75 references.

References · 10

  1. 2016Revisiting Classifier Two-Sample Testscited by 258
  2. 2022Turning the Tables: Biased, Imbalanced, Dynamic Tabular Datasets for ML Evaluationcited by 39
  3. 2019Multivariate Rank-based Distribution-free Nonparametric Testing using Measure Transportationcited by 24
  4. 2017Nonparametric independence testing via mutual informationcited by 22
  5. 2021A Witness Two-Sample Testcited by 20
  6. 2015Measuring dependence powerfully and equitablycited by 7
  7. 2014Consistent distribution-free K-sample and independence tests for univariate random variablescited by 5
  8. 2023A High-dimensional Convergence Theorem for U-statistics with Applications to Kernel-based Testingcited by 5
  9. 2021Concentration Inequalities for Two-Sample Rank Processes with Application to Bipartite Rankingcited by 3
  10. 2021Data-Driven Representations for Testing Independence: Modeling, Analysis and Connection with Mutual Information Estimationcited by 2

Built on by

Not cited yet.