Role-guided Speaker Deletion Verification in Clinical Psychiatry Speech Recordings with Audio Language Models
Not on the map. Why?
Abstract (arXiv)
Clinical research in psychiatry increasingly relies on large scale collection of spoken language data to identify acoustic and linguistic biomarkers. Yet evolving consent and protocol requirements can oblige investigators to remove a designated speaker from multi-speaker recordings and to verify said removal at a scale infeasible for manual review of entire corpora. We study this verification problem for role-driven dyadic clinical dialogue in psychiatry and investigate it with two parallel, symmetric pipelines: confirming that clinician speech has been removed from psychiatric interview recordings, and confirming that patient speech has been removed from the same recordings. Each pipeline redacts the raw audio for its target role and then scans the surviving output with audio-language and large-language models to identify missed deletions. We evaluate this approach on a corpus of 48 dyadic recordings drawn from psychiatry settings, testing four open-weight models in an inference-only setting: Gemma-4-12B, Gemma-4-31B, Nemotron-3-Nano, and Nemotron-3-Nano-Omni. A disjunctive OR ensemble over fourteen model-view configurations had a combined F1 of 0.478 (precision 0.330, recall 0.870), an improvement over individual model estimates driven by recall gains that point to substantial complementarity across models and context views.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 24 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
13 of 24 references.
References · 13
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2024Phi-4 Technical Reportcited by 711
- 2019pyannote.audio: neural building blocks for speaker diarizationcited by 181
- 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 124
- 2018VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Maskingcited by 73
- 2020Target-Speaker Voice Activity Detection: a Novel Approach for Multi-Speaker Diarization in a Dinner Party Scenariocited by 68
- 2026Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligencecited by 30
- 2019Personal VAD: Speaker-Conditioned Voice Activity Detectioncited by 25
- 2026Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Musiccited by 19
- 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
Built on by
Not cited yet.