DiaWhisper-DPO: Role-Attributed Transcription of Clinical Interviews via Failure-Mined Preference Optimization
On the map: LLM alignment / RLHF / preference optimisation → Medical LLM alignment
Abstract (arXiv)
Automated depression screening from clinical interviews requires attribution of utterances to the clinician or patient. We evaluate two datasets: DAIC-WOZ, where participant-only recordings require re-synthesizing both sides for controlled two-party evaluation, and PDCH-HAMD, comprising voice-converted real Chinese interviews for cross-lingual validation. Cascaded systems combine speaker diarization with role-assignment heuristics, so errors can propagate across stages. We propose an end-to-end model, which we named DiaWhisper, that fine-tunes Whisper-large-v3 with LoRA and an auxiliary frame-level role head for transcription and attribution, together with DiaWhisper-DPO, a failure-mined refinement that uses genuine decoding failures as DPO rejected completions without human preference annotation. On 29 DAIC-WOZ test sessions, DiaWhisper-DPO achieves 0.973 role accuracy and 0.119 DER, 72% below the strongest cascaded baseline, and reduces seed variation from σ = .205 to .002. Retrained on PDCH-HAMD, it achieves 0.757 role accuracy and improves all 78 session-seed pairs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical LLM alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 17 of its 24 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
17 of 24 references.
References · 17
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2019AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognitioncited by 87
- 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
- 2019Joint Speech Recognition and Speaker Diarization via Sequence Transductioncited by 49
- 2024LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASRcited by 36
5 more
- 2018Topic Modeling Based Multi-modal Depression Detectioncited by 29
- 20243D-Speaker-Toolkit: An Open-Source Toolkit for Multimodal Speaker Verification and Diarizationcited by 16
- 2024DAIC-WOZ: On the Validity of Using the Therapist's prompts in Automatic Depression Detection from Clinical Interviewscited by 15
- 2026Direct Preference Optimization for English-Mandarin Code-Switching Speech Recognition in Audio LLMscited by 2
- 2026End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactionscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026StageWell: A Process-Aligned Chinese Corpus for Positive-Psychology Support Dialogue
- 2026PVminerLLM2: Improving Structured Extraction of Patient Voice via Preference Optimization
- 2025LLAMADRS: Evaluating Open-Source LLMs on Real Clinical Interviews--To Reason or Not to Reason?
- 2025Eeyore: Realistic Depression Simulation via Supervised and Preference Optimization
- 2026Dep-LLM: Training-Free Depression Diagnosis via Evidence-Guided Structured Multi-factor with Reliable LLM Reasoning
- 2026DS@GT ARC at eRisk 2026: Hybrid Multi-Agent LLM System with Structured Algorithmic Guidance for Conversational Depression Screening
- 2026LingxiDiagBench: A Multi-Agent Framework for Benchmarking LLMs in Chinese Psychiatric Consultation and Diagnosis
- 2026LLMdoctor: Token-Level Flow-Guided Preference Optimization for Efficient Test-Time Alignment of Large Language Models