Improving Learning-to-Defer Algorithms Through Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
The ubiquity of AI leads to situations where humans and AI work together, creating the need for learning-to-defer algorithms that determine how to partition tasks between AI and humans. We work to improve learning-to-defer algorithms when paired with specific individuals by incorporating two fine-tuning algorithms and testing their efficacy using both synthetic and image datasets. We find that fine-tuning can pick up on simple human skill patterns, but struggles with nuance, and we suggest future work that uses robust semi-supervised to improve learning.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 10 of its 21 references that are in the map. First posted on arXiv 18 Dec 2021.
Builds on
10 of 21 references.
References · 10
- 2016Wide Residual Networkscited by 3,070
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 271
- 2019Human uncertainty makes classification more robustcited by 235
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2020Learning to Complement Humanscited by 124
- 2019The Algorithmic Automation Problem: Prediction, Triage, and Human Effortcited by 101
- 2021Differentiable Learning Under Triagecited by 76
- 2021Towards Unbiased and Accurate Deferral to Multiple Expertscited by 72
- 2020Classification Under Human Assistancecited by 42
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2; 2025: 2; 2026: 3.
11 papers.
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 70
- 2022Sample Efficient Learning of Predictors that Complement Humanscited by 46
- 2023Principled Approaches for Learning to Defer with Multiple Expertscited by 38
- 2024Realizable H-Consistent and Bayes-Consistent Loss Functions for Learning to Defercited by 26
- 2023Learning to Defer with Limited Expert Predictionscited by 25
- 2024AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systemscited by 7
- 2026Consistent Learning-to-Defer with Expert-Conditional Advicecited by 3
- 2026Optimized Deferral for Imbalanced Settingscited by 2
- 2025Bayesian Inference for Correlated Human Experts and Classifierscited by 1
- 2025Learning To Defer To A Population With Limited Demonstrationscited by 0
- 2026A Query Is Not a Commitment: Learning to Correct Expert Answers in Online Deferralcited by 0
- 2026A Query Is Not a Commitment: Learning to Correct Expert Answers in Online Deferral5 Oct 2026
- 2026Optimized Deferral for Imbalanced Settings30 Apr 2026
- 2026Consistent Learning-to-Defer with Expert-Conditional Advice15 Mar 2026
- 2025Learning To Defer To A Population With Limited Demonstrations22 Oct 2025
- 2025Bayesian Inference for Correlated Human Experts and Classifiers5 Jun 2025
- 2024Realizable H-Consistent and Bayes-Consistent Loss Functions for Learning to Defer18 Jul 2024
- 2024AI, Meet Human: Learning Paradigms for Hybrid Decision Making Systems9 Feb 2024
- 2023Principled Approaches for Learning to Defer with Multiple Experts23 Oct 2023
- 2023Learning to Defer with Limited Expert Predictions14 Apr 2023
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humans15 Jan 2023
- 2022Sample Efficient Learning of Predictors that Complement Humans19 Jul 2022