Automation Bias in AI-Assisted Medical Decision-Making under Time Pressure in Computational Pathology
Not on the map. Why?
Abstract (arXiv)
Artificial intelligence (AI)-based clinical decision support systems (CDSS) promise to enhance diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration might introduce automation bias, where users uncritically follow automated cues. This bias may worsen when time pressure strains practitioners' cognitive resources. We quantified automation bias by measuring the adoption of negative system consultations and examined the role of time pressure in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results indicate that while AI integration led to a statistically significant increase in overall performance, it also resulted in a 7% automation bias rate, where initially correct evaluations were overturned by erroneous AI advice. Conversely, time pressure did not exacerbate automation bias occurrence, but appeared to increase its severity, evidenced by heightened reliance on the system's negative consultations and subsequent performance decline. These findings highlight potential risks of AI use in healthcare.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Nov 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Modelcited by 3
- 2026Can Agents Distinguish Visually Hard-to-Separate Diseases in a Zero-Shot Setting? A Pilot Studycited by 1
- 2026Offloading Score: Measuring AI Reliance Through Counterfactual Workflowscited by 1
- 2026Algorithmic Authority and the Clinical Standard of Carecited by 0
- 2026Engineering Reliable Coding Agents: Evaluating and Operating the System Around the Model14 Aug 2026
- 2026Offloading Score: Measuring AI Reliance Through Counterfactual Workflows28 May 2026
- 2026Algorithmic Authority and the Clinical Standard of Care29 Apr 2026
- 2026Can Agents Distinguish Visually Hard-to-Separate Diseases in a Zero-Shot Setting? A Pilot Study26 Feb 2026