L2CU: Learning to Complement Unseen Users
Not on the map. Why?
Abstract (arXiv)
Recent research highlights the potential of machine learning models to learn to complement (L2C) human strengths; however, generalizing this capability to unseen users remains a significant challenge. Existing L2C methods oversimplify interaction between human and AI by relying on a single, global user model that neglects individual user variability, leading to suboptimal cooperative performance. Addressing this, we introduce L2CU, a novel L2C framework for human-AI cooperative classification with unseen users. Given sparse and noisy user annotations, L2CU identifies representative annotator profiles capturing distinct labeling patterns. By matching unseen users to these profiles, L2CU leverages profile-specific models to complement the user and achieve superior joint accuracy. We evaluate L2CU on datasets (CIFAR-10N, CIFAR-10H, Fashion-MNIST-H, Chaoyang and AgNews), demonstrating its effectiveness as a model-agnostic solution for improving human-AI cooperative classification.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 3 Jan 2026.
Builds on
43 of 56 references.
References · 43
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2020DivideMix: Learning with Noisy Labels as Semi-supervised Learningcited by 692
- 2016Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approachcited by 665
- 2020Learning from Noisy Labels with Deep Neural Networks: A Surveycited by 582
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 416
31 more
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2021Learning with Noisy Labels Revisited: A Study Using Real-World Human Annotationscited by 256
- 2019Human uncertainty makes classification more robustcited by 235
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2020Learning to Complement Humanscited by 124
- 2022Selective-Supervised Contrastive Learning with Noisy Labelscited by 112
- 2019The Algorithmic Automation Problem: Prediction, Triage, and Human Effortcited by 101
- 2022UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learningcited by 77
- 2021Differentiable Learning Under Triagecited by 76
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 70
- 2021Contrast to Divide: Self-Supervised Pre-Training for Learning with Noisy Labelscited by 69
- 2022Calibrated Learning to Defer with One-vs-All Classifierscited by 69
- 2021Instance-dependent Label-noise Learning under a Structural Causal Modelcited by 50
- 2021Hard Sample Aware Noise Robust Learning for Histopathology Image Classificationcited by 48
- 2021Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibrationcited by 40
- 2022Identifiability of Label Noise Transition Matrixcited by 34
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
- 2024Learning to Defer to a Population: A Meta-Learning Approachcited by 27
- 2022Is the Performance of My Deep Network Too Good to Be True? A Direct Approach to Estimating the Bayes Error in Binary Classificationcited by 26
- 2022Uncalibrated Models Can Improve Human-AI Collaborationcited by 26
- 2022CROWDLAB: Supervised learning to infer consensus labels and quality scores for data with multiple annotatorscited by 16
- 2022ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labelscited by 15
- 2018Fast Dawid-Skene: A Fast Vote Aggregation Scheme for Sentiment Classificationcited by 12
- 2022Trustable Co-label Learning from Multiple Noisy Annotatorscited by 12
- 2023Transferring Annotator- and Instance-dependent Transition Matrix for Learning from Crowdscited by 11
- 2023Coupled Confusion Correction: Learning from Crowds with Sparse Annotationscited by 9
- 2024Learning to Complement and to Defer to Multiple Userscited by 7
- 2023Learning to Complement with Multiple Humanscited by 5
- 2023Instance-dependent Noisy-label Learning with Graphical Model Based Noise-rate Estimationcited by 4
- 2025Identity-Free Deferral For Unseen Expertscited by 4
- 2023FiFAR: A Fraud Detection Dataset for Learning to Defercited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.