A Copula Based Supervised Filter for Feature Selection in Diabetes Risk Prediction Using Machine Learning
Not on the map. Why?
Abstract (arXiv)
Effective feature selection is critical for robust and interpretable predictive modeling in medicine, especially when risk factors matter most in extreme patient strata. Many standard selectors emphasize average associations and can miss predictors whose relevance is concentrated in the distribution tails. We propose a computationally efficient supervised filter based on a Gumbel-copula implied upper-tail concordance score (lambda U), defined as a monotone transformation of Kendall's tau, to rank features by their tendency to be simultaneously extreme with the positive class. We compare against four common baselines (Mutual Information, mRMR, ReliefF, and L1/Elastic-Net) across four classifiers on two diabetes datasets: a large-scale public health survey (CDC, N=253,680) and a clinical benchmark (PIMA, N=768). Analyses include statistical testing, permutation importance, and robustness checks. On CDC, the proposed selector is the fastest and reduces 21 features to 10 (approx 52%). This yields a small but statistically significant trade-off relative to using all features, while performing better than standard filters (Mutual Information, mRMR) and comparably to the strong ReliefF baseline. On PIMA (8 predictors), the resulting ranking attains the highest ROC-AUC numerically, though paired DeLong tests show no significant differences versus strong baselines; PIMA therefore serves as a ranking-only sanity check in a low-dimensional setting. Across both datasets, the lambda U-based selector highlights clinically coherent predictors and provides an efficient, interpretable screening step that can complement standard feature-selection methods in public health and clinical risk prediction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 65 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
5 of 65 references.
References · 5
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2013Equitability, mutual information, and the maximal information coefficientcited by 45
- 2019Variable Selection with Copula Entropycited by 5
- 2013Copula Correlation: An Equitable Dependence Measure and Extension of Pearson's Correlationcited by 1
Built on by
Not cited yet.