# Leveraging Noisy Manual Labels as Useful Information: An Information Fusion Approach for Enhanced Variable Selection in Penalized Logistic Regression

arXiv: https://arxiv.org/abs/2504.16585 · HTML: https://mlsanity.com/paper/2504.16585/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 9 of its 42 references that are in the map.
- First posted on arXiv 23 Apr 2025.

## Builds on (most cited first, 9 of 9)

- [Classification with Asymmetric Label Noise: Consistency and Maximal Denoising](https://mlsanity.com/paper/1303.1208/) (2013)
- [Positive-incentive Noise](https://mlsanity.com/paper/2212.09541/) (2022)
- [Stacked Penalized Logistic Regression for Selecting Views in Multi-View Learning](https://mlsanity.com/paper/1811.02316/) (2018)
- [Binary classification with corrupted labels](https://mlsanity.com/paper/2106.09136/) (2021)
- [Extensions of ADMM for Separable Convex Optimization Problems with Linear Equality or Inequality Constraints](https://mlsanity.com/paper/2107.01897/) (2021)
- [Asymmetric error control under imperfect supervision: a label-noise-adjusted Neyman-Pearson umbrella algorithm](https://mlsanity.com/paper/2112.00314/) (2021)
- [Harmless label noise and informative soft-labels in supervised classification](https://mlsanity.com/paper/2104.02872/) (2021)
- [A unified consensus-based parallel ADMM algorithm for high-dimensional regression with combined regularizations](https://mlsanity.com/paper/2311.12319/) (2023)
- [Convex and Non-convex Approaches for Statistical Inference with Class-Conditional Noisy Labels](https://mlsanity.com/paper/1910.02348/) (2019)

## Abstract (arXiv)

In large-scale supervised learning, penalized logistic regression (PLR) effectively mitigates overfitting through regularization, yet its performance critically depends on robust variable selection. This paper demonstrates that label noise introduced during manual annotation, often dismissed as a mere artifact, can serve as a valuable source of information to enhance variable selection in PLR. We theoretically show that such noise, intrinsically linked to classification difficulty, helps refine the estimation of non-zero coefficients compared to using only ground truth labels, effectively turning a common imperfection into a useful information resource. To efficiently leverage this form of information fusion in large-scale settings where data cannot be stored on a single machine, we propose a novel partition insensitive parallel algorithm based on the alternating direction method of multipliers (ADMM). Our method ensures that the solution remains invariant to how data is distributed across workers, a key property for reproducible and stable distributed learning, while guaranteeing global convergence at a sublinear rate. Extensive experiments on multiple large-scale datasets show that the proposed approach consistently outperforms conventional variable selection techniques in both estimation accuracy and classification performance, affirming the value of intentionally fusing noisy manual labels into the learning process.