When Can Human-AI Teams Outperform Individuals? Tight Bounds with Impossibility Guarantees
Not on the map. Why?
Abstract (arXiv)
Human-AI teams fail to outperform their best member in 70% of studies, yet no theory specifies when complementarity is achievable. We derive tight bounds for the broad class of confidence-based aggregation rules by integrating signal detection theory with information-theoretic analysis, yielding four results: (1) a complementarity theorem (teams outperform individuals iff error correlation ρHM < ρ^*, with ρ^* ≈ a in the symmetric near-chance regime); (2) minimax bounds showing gains scale as Theta(√Delta d) with metacognitive sensitivity difference; (3) an impossibility result proving no confidence-based aggregation rule achieves complementarity when ρHM ≥ ρ^*; and (4) multi-class generalization ρ^*K ≈ ρ^*/√K-1. Predictions match observed team accuracy (R = 0.94 on ImageNet-16H, R = 0.91 on CIFAR-10H) and the multi-class threshold scaling holds on human data (R = 0.93, K = 16), with robustness under non-Gaussian distributions. The framework explains why complementarity is rare and provides actionable design formulas; results apply to aggregation, not to interactive deliberation that generates novel answers.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 32 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
8 of 32 references.
References · 8
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2020Effect of Confidence and Explanation on Accuracy and Trust Calibration in AI-Assisted Decision Makingcited by 281
- 2020Consistent Estimators for Learning to Defer to an Expertcited by 262
- 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 129
- 2024When combinations of humans and AI are useful: A systematic review and meta-analysiscited by 100
- 2023A Unified Theory of Diversity in Ensemble Learningcited by 71
- 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 68
- 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidencecited by 35
Built on by
Not cited yet.