Human aversion? Do AI Agents Judge Identity More Harshly Than Performance
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
This study examines the understudied role of algorithmic evaluation of human judgment in hybrid decision-making systems, a critical gap in management research. While extant literature focuses on human reluctance to follow algorithmic advice, we reverse the perspective by investigating how AI agents based on large language models (LLMs) assess and integrate human input. Our work addresses a pressing managerial constraint: firms barred from deploying LLMs directly due to privacy concerns can still leverage them as mediating tools (for instance, anonymized outputs or decision pipelines) to guide high-stakes choices like pricing or discounts without exposing proprietary data. Through a controlled prediction task, we analyze how an LLM-based AI agent weights human versus algorithmic predictions. We find that the AI system systematically discounts human advice, penalizing human errors more severely than algorithmic errors--a bias exacerbated when the agent's identity (human vs AI) is disclosed and the human is positioned second. These results reveal a disconnect between AI-generated trust metrics and the actual influence of human judgment, challenging assumptions about equitable human-AI collaboration. Our findings offer three key contributions. First, we identify a reverse algorithm aversion phenomenon, where AI agents undervalue human input despite comparable error rates. Second, we demonstrate how disclosure and positional bias interact to amplify this effect, with implications for system design. Third, we provide a framework for indirect LLM deployment that balances predictive power with data privacy. For practitioners, this research emphasize the need to audit AI weighting mechanisms, calibrate trust dynamics, and strategically design decision sequences in human-AI systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 6 of its 17 references that are in the map. First posted on arXiv 31 Mar 2025.
Builds on
6 of 17 references.
References · 6
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 396
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
- 2019Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practicescited by 170
- 2018The Disparate Effects of Strategic Manipulationcited by 75
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
- 2025Measuring and identifying factors of individuals' trust in Large Language Modelscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Language Models Exhibit Inconsistent Biases Towards Algorithmic Agents and Human Experts
- 2025From Digital Distrust to Codified Honesty: Experimental Evidence on Generative AI in Credence Goods Markets ↗
- 2025A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- 2025A closer look at how large language models trust humans: patterns and biases
- 2025The Basic B*** Effect: The Use of LLM-based Agents Reduces the Distinctiveness and Diversity of People's Choices
- 2022Measuring an artificial intelligence agent's trust in humans using machine incentives
- 2026From Role to Person: Trust Calibration Challenges in Twin Agents
- 2025Teaching AI to Handle Exceptions: Supervised Fine-Tuning with Human-Aligned Judgment