Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challenge
Not on the map. Why?
Abstract (arXiv)
The second Multilingual Conversational Speech Language Model (MLC-SLM) Challenge evaluates two tasks over complete, unsegmented multilingual conversations: speaker diarization and recognition (Task 1) and conversational speech understanding (Task 2). Neither task provides oracle utterance boundaries or speaker labels at evaluation, and Task 2 provides no question-answer training set. For Task 1, we fine-tune VibeVoice-ASR-7B with random leading-silence cropping, consistent timestamp correction, and an exponential moving average (EMA) training strategy. For Task 2, we construct synthetic question-answer pairs through multimodal candidate generation, silent-audio filtering, and distribution-matched augmentation, and fine-tune Qwen3-Omni-30B-A3B-Instruct for tagged direct answering. On the Task 1 evaluation set, cropping reduces tcpMER from 18.30% to 17.27%, and EMA further reduces it to 16.73%. On the Task 2 evaluation set, jointly applying distribution-matched augmentation and tagged direct answering raises accuracy from 83.0% to 86.0%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
22 of 25 references.
References · 22
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2016Training Deep Nets with Sublinear Memory Costcited by 848
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024Qwen2-Audio Technical Reportcited by 560
- 2025Qwen3-Omni Technical Reportcited by 497
- 2023Listen, Think, and Understandcited by 209
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 133
- 2024Exponential Moving Average of Weights in Deep Learning: Dynamics and Benefitscited by 71
10 more
- 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
- 2020Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordingscited by 28
- 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 28
- 2020Speech Recognition and Multi-Speaker Diarization of Long Conversationscited by 23
- 2021Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASRcited by 22
- 2026VIBEVOICE-ASR Technical Reportcited by 16
- 2025Measuring Audio's Impact on Correctness: Audio-Contribution-Aware Post-Training of Large Audio Language Modelscited by 15
- 2025When Audio and Text Disagree: Revealing Text Bias in Large Audio-Language Modelscited by 13
- 2025BLAB: Brutally Long Audio Benchcited by 11
- 2025Word Error Rate Definitions and Algorithms for Long-Form Multi-talker Speech Recognitioncited by 6
Built on by
Not cited yet.