mlsanityData to 14 Oct 2026

An Omnilingual-ASR-Based Speech-LLM System for the 2nd MLC-SLM Challenge

arXiv 2607.12468 ↗First posted 14 Jul 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We describe our submission to Task 1 of the 2nd MLCSLM Challenge: a cascaded diarization-then-recognition system that combines DiariZen-Large-s80 (WavLM-Large) segmentation, CAM++ embedding-based two-speaker clustering, and a LoRA-adapted omniASR LLM 7B v2 recognizer, with no oracle segmentation or speaker labels at test time. On the official Development set (150 conversations, 21 language/accent categories) the system attains a macro tcpMER of 29.27%, versus 79.15% for the official baseline; on the Evaluation set it scores 50.23%. We also analyze two engineering choices that substantially affect tcpMER. First, embedding-based speaker clustering outperforms an end-to-end-style alternative that assigns speakers from ASR <sc> turn markers alone. Second, overlap-aware segmentation, although intended to raise diarization recall, increases tcpMER because overlapped speech is transcribed twice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 14 Jul 2026.

Builds on

11 of 14 references.

References · 11

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Powerset multi-class cross entropy loss for neural speaker diarizationcited by 111
  3. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 102
  4. 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 95
  5. 2020Auto-Tuning Spectral Clustering for Speaker Diarization Using Normalized Maximum Eigengapcited by 36
  6. 2025Omnilingual ASR: Open-Source Multilingual Speech Recognition for 1600+ Languagescited by 34
  7. 2023MeetEval: A Toolkit for Computation of Word Error Rates for Meeting Transcription Systemscited by 28
  8. 2024Leveraging Self-Supervised Learning for Speaker Diarizationcited by 23
  9. 20243D-Speaker-Toolkit: An Open-Source Toolkit for Multimodal Speaker Verification and Diarizationcited by 16
  10. 2022Personal VAD 2.0: Optimizing Personal Voice Activity Detection for On-Device Speech Recognitioncited by 12
  11. 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10

Built on by

Not cited yet.