mlsanityData to 14 Oct 2026

Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarization

arXiv 2604.06138 ↗First posted 7 Apr 2026cs.SD cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open-ended generation tasks most relevant to long-context reasoning pose well-known challenges for automatic evaluation. We propose a synthetic data generation pipeline designed to serve both as a training resource and as a controlled evaluation environment, and instantiate it for first-visit doctor-patient conversations with SOAP note generation as the task. The pipeline has three stages, persona-driven dialogue generation, multi-speaker audio synthesis with overlap/pause modeling, room acoustics, and sound events, and LLM-based reference SOAP note production, built entirely on open-weight models. We release 8,800 synthetic conversations with 1.3k hours of corresponding audio and reference notes. Evaluating current open-weight systems, we find that cascaded approaches still substantially outperform end-to-end models.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 34 of its 38 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

34 of 38 references.

References · 34

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  5. 2025Gemma 3 Technical Reportcited by 1,824
  6. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  7. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
  8. 2025Kimi K2: Open Agentic Intelligencecited by 567
  9. 2025Qwen3-Omni Technical Reportcited by 497
  10. 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
  11. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  12. 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 219
22 more
  1. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 133
  2. 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 132
  3. 2023ACI-BENCH: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generationcited by 118
  4. 2026Qwen3-ASR Technical Reportcited by 118
  5. 2025Baichuan-Omni-1.5 Technical Reportcited by 111
  6. 2024The T05 System for The VoiceMOS Challenge 2024: Transfer Learning from Deep Image Classifier to Naturalness MOS Prediction of High-Quality Synthetic Speechcited by 83
  7. 2025MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligencecited by 61
  8. 2023NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notescited by 48
  9. 2021Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversationscited by 42
  10. 2022PriMock57: A Dataset Of Primary Care Mock Consultationscited by 31
  11. 2025Do Audio LLMs Really LISTEN, or Just Transcribe? Measuring Lexical vs. Acoustic Emotion Cues Reliancecited by 24
  12. 2021Speech Summarization using Restricted Self-Attentioncited by 23
  13. 2022Revisiting text decomposition methods for NLI-based factuality scoring of summariescited by 14
  14. 2025BLAB: Brutally Long Audio Benchcited by 11
  15. 2021Understanding Medical Conversations: Rich Transcription, Confidence Scores & Information Extractioncited by 10
  16. 2024Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognitioncited by 9
  17. 2026Closing the Modality Reasoning Gap for Speech Large Language Modelscited by 9
  18. 2020The Medical Scribe: Corpus Development and Model Performance Analysescited by 6
  19. 2026The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASRrightarrowLLM Pipelines?cited by 5
  20. 2025Uni-VERSA: Versatile Speech Assessment with a Unified Networkcited by 3
  21. 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluationcited by 3
  22. 2026Benchmarking Speech Systems for Frontline Health Conversations: The DISPLACE-M Challengecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.