The inattentional gap in task conditioned AI models that omit otherwise reportable safety critical signals
Not on the map. Why?
Abstract (arXiv)
AI in radiology and other safety-critical workflows is evaluated on the hazards it is told to find, yet harm arises disproportionately from hazards no one specified. We show that conditioning a language or vision model on a narrow task suppresses its reporting of co-present, safety-critical signals it can otherwise report, a behavioral analogue of human inattentional blindness. Across radiology text scenarios and thoracic-image vision tasks, ordinary focused instructions suppressed reporting by up to 0.92; the gap ranged from minimal to complete across seven models, did not vary monotonically with scale, and persisted in a reasoning model, while one flagship model showed a robust safety-reporting override. We term this dissociation the Inattentional Gap: a system can score near-perfectly on specified hazards while omitting co-present safety-critical hazards. In a 24-scenario probe, an independent open-ended critic restored every omitted finding. We propose reporting-complete evaluation as an admission criterion for safety-critical deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 25 Jun 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CRAFT: Causal Responsibility and Failure Tracing in Medical Vision Language Models
- 2025Evaluation Faking: Unveiling Observer Effects in Safety Evaluation of Frontier AI Systems
- 2026EviSafe: Evidence-Grounded Safety Evaluation for Vision-Language Models
- 2026From Local Evidence to Safety Verdicts: Causal Tracing in Vision-Language Models
- 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
- 2023Explainable AI And Visual Reasoning: Insights From Radiology
- 2026SAVeS: Steering Safety Judgments in Vision-Language Models via Semantic Cues
- 2026HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models