Reliable Active Learning from Unreliable Labels via Neural Collapse Geometry
Not on the map. Why?
Abstract (arXiv)
Active Learning (AL) promises to reduce annotation cost by prioritizing informative samples, yet its reliability is undermined when labels are noisy or when the data distribution shifts. In practice, annotators make mistakes, rare categories are ambiguous, and conventional AL heuristics (uncertainty, diversity) often amplify such errors by repeatedly selecting mislabeled or redundant samples. We propose Reliable Active Learning via Neural Collapse Geometry (NCAL-R), a framework that leverages the emergent geometric regularities of deep networks to counteract unreliable supervision. Our method introduces two complementary signals: (i) a Class-Mean Alignment Perturbation score, which quantifies how candidate samples structurally stabilize or distort inter-class geometry, and (ii) a Feature Fluctuation score, which captures temporal instability of representations across training checkpoints. By combining these signals, NCAL-R prioritizes samples that both preserve class separation and highlight ambiguous regions, mitigating the effect of noisy or redundant labels. Experiments on ImageNet-100 and CIFAR100 show that NCAL-R consistently outperforms standard AL baselines, achieving higher accuracy with fewer labels, improved robustness under synthetic label noise, and stronger generalization to out-of-distribution data. These results suggest that incorporating geometric reliability criteria into acquisition decisions can make Active Learning less brittle to annotation errors and distribution shifts, a key step toward trustworthy deployment in real-world labeling pipelines. Our code is available at https://github.com/Vision-IIITD/NCAL.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 14 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
10 of 14 references.
References · 10
- 2017Deep Bayesian Active Learning with Image Datacited by 819
- 2020Prevalence of Neural Collapse during the terminal phase of deep learning trainingcited by 719
- 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 610
- 2019Variational Adversarial Active Learningcited by 284
- 2020Contextual Diversity for Active Learningcited by 139
- 2023NECO: NEural Collapse Based Out-of-distribution detectioncited by 42
- 2020How does Weight Correlation Affect the Generalisation Ability of Deep Neural Networkscited by 32
- 2024Active Generalized Category Discoverycited by 31
- 2022Linking Neural Collapse and L2 Normalization with Improved Out-of-Distribution Detection in Deep Neural Networkscited by 23
- 2025Joint Out-of-Distribution Filtering and Data Discovery Active Learningcited by 7
Built on by
Not cited yet.