mlsanityData to 7 Oct 2026

Perfecting Human-AI Interaction at Clinical Scale. Turning Production Signals into Safer, More Human Conversations

arXiv 2603.29893 ↗First posted 9 Feb 2026cs.HC cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Healthcare conversational AI agents shouldn't be optimized only for clean benchmark accuracy in production-first regime; they must be optimized for the lived reality of patient conversations, where audio is imperfect, intent is indirect, language shifts mid-call, and compliance hinges on how guidance is delivered. We present a production-validated framework grounded in real-time signals from 115M+ live patient-AI interactions and clinician-led testing (7K+ licensed clinicians; 500K+ test calls). These in-the-wild cues -- paralinguistics, turn-taking dynamics, clarification triggers, escalation markers, multilingual continuity, and workflow confirmations -- reveal failure modes that curated data misses and provide actionable training and evaluation signals for safety and reliability. We further show why healthcare-grade safety cannot rely on a single LLM: long-horizon dialogue and limited attention demand redundancy via governed orchestration, independent checks, and verification. Many apparent "reasoning" errors originate upstream, motivating vertical integration across contextual ASR, clarification/repair, ambient speech handling, and latency-aware model/hardware choices. Treating interaction intelligence (tone, pacing, empathy, clarification, turn-taking) as first-class safety variables, we drive measurable gains in safety, documentation, task completion, and equity in building the safest generative AI solution for autonomous patient-facing care. Deployed across more than 10 million real patient calls, Polaris attains a clinical safety score of 99.9%, while significantly improving patient experience with average patient rating of 8.95 and reducing ASR errors by 50% over enterprise ASR. These results establish real-world interaction intelligence as a critical -- and previously underexplored -- determinant of safety and reliability in patient-facing clinical AI systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 58 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

23 of 58 references.

References · 23

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  7. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  8. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  9. 2023Google USM: Scaling Automatic Speech Recognition Beyond 100 Languagescited by 228
  10. 2024The Unreasonable Ineffectiveness of the Deeper Layerscited by 219
  11. 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 157
  12. 2024Benchmarking Large Language Models on Answering and Explaining Challenging Medical Questionscited by 106
11 more
  1. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
  2. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
  3. 2024MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notescited by 77
  4. 2024MedCalc-Bench: Evaluating Large Language Models for Medical Calculationscited by 64
  5. 2023Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBenchcited by 54
  6. 2024Polaris: A Safety-focused LLM Constellation Architecture for Healthcarecited by 27
  7. 2023Large language models in medicine: the potentials and pitfallscited by 21
  8. 2025Audio-Aware Large Language Models as Judges for Speaking Stylescited by 17
  9. 2022Toward expanding the scope of radiology report summarization to multiple anatomies and modalitiescited by 14
  10. 2026HEART: A Unified Benchmark for Assessing Humans and LLMs in Emotional Support Dialoguecited by 12
  11. 2025H2HTalk: Evaluating Large Language Models as Emotional Companioncited by 3

Built on by

Not cited yet.