Perfecting Human-AI Interaction at Clinical Scale. Turning Production Signals into Safer, More Human Conversations
Not on the map. Why?
Abstract (arXiv)
Healthcare conversational AI agents shouldn't be optimized only for clean benchmark accuracy in production-first regime; they must be optimized for the lived reality of patient conversations, where audio is imperfect, intent is indirect, language shifts mid-call, and compliance hinges on how guidance is delivered. We present a production-validated framework grounded in real-time signals from 115M+ live patient-AI interactions and clinician-led testing (7K+ licensed clinicians; 500K+ test calls). These in-the-wild cues -- paralinguistics, turn-taking dynamics, clarification triggers, escalation markers, multilingual continuity, and workflow confirmations -- reveal failure modes that curated data misses and provide actionable training and evaluation signals for safety and reliability. We further show why healthcare-grade safety cannot rely on a single LLM: long-horizon dialogue and limited attention demand redundancy via governed orchestration, independent checks, and verification. Many apparent "reasoning" errors originate upstream, motivating vertical integration across contextual ASR, clarification/repair, ambient speech handling, and latency-aware model/hardware choices. Treating interaction intelligence (tone, pacing, empathy, clarification, turn-taking) as first-class safety variables, we drive measurable gains in safety, documentation, task completion, and equity in building the safest generative AI solution for autonomous patient-facing care. Deployed across more than 10 million real patient calls, Polaris attains a clinical safety score of 99.9%, while significantly improving patient experience with average patient rating of 8.95 and reducing ASR errors by 50% over enterprise ASR. These results establish real-world interaction intelligence as a critical -- and previously underexplored -- determinant of safety and reliability in patient-facing clinical AI systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
23 of 58 references.
References · 23
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
- 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
- 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 157
- 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 106
11 more
- 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
- 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
- 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 77
- 2024MedCalc-Bench: Evaluating Large Language Models for Medical Calculationscited by 64
- 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
- 2024Polaris: A Safety-focused LLM Constellation Architecture for Healthcarecited by 27
- 2023Large language models in medicine: the potentials and pitfallscited by 21
- 2025Audio-Aware Large Language Models as Judges for Speaking Stylescited by 17
- 2022Toward expanding the scope of radiology report summarization to multiple anatomies and modalitiescited by 14
- 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 12
- 2025H2HTalk: Evaluating Large Language Models as Emotional Companioncited by 3
Built on by
Not cited yet.