mlsanityData to 14 Oct 2026

A bilingual AI audiologist built through rubric-guided closed-loop engineering outperforms human audiologists in a blinded evaluation of simulated cases

arXiv 2609.32220 ↗First posted 26 Sep 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Audiology consultation requires structured history-taking, audiometric interpretation and patient-centred communication, yet real-world case material is scarce. We present a bilingual AI audiologist pairing a general-purpose large language model with rubric-guided closed-loop engineering, multimodal audiogram interpretation and retrieval-augmented grounding, without fine-tuning the language-model backbone. Using a 21-item rubric and an AI patient simulator, we distilled experience-derived guidance into a 19-rule playbook from 73 training cases (43 English, 30 Chinese) and evaluated the system on 58 independent simulated cases (30 Chinese, 28 English) in a pre-specified, source-blinded comparison with 17 practising audiologists. The AI audiologist outperformed human audiologists on every case (58/58; mean paired Delta = +1.35 on a 5-point composite, Cohen's d = 1.84, P = 4.5 × 10-20), on 20 of 21 rubric items and in both languages. Component ablation identified the playbook as the largest contributor, offering a practical route to specialist consultation agents in low-data medical domains.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). First posted on arXiv 26 Sep 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Sound of Syntax: Finetuning and Comprehensive Evaluation of Language Models for Speech Pathology
  2. 2026AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following
  3. 2025MedVoiceBias: A Controlled Study of Audio LLM Behavior in Clinical Decision-Making
  4. 2025CaReAQA: A Cardiac and Respiratory Audio Question Answering Model for Open-Ended Diagnostic Reasoning
  5. 2025Context-Adaptive Hearing Aid Fitting Advisor through Multi-turn Multimodal LLM Conversation ↗
  6. 2023HuatuoGPT, towards Taming Language Model to Be a Doctor
  7. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulator
  8. 2026MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio