mlsanityData to 7 Oct 2026

Xiaomi-CocktailASR-1 Technical Report

arXiv 2609.11274 ↗First posted 10 Sep 2026cs.SD cs.CL eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Recently, large language model (LLM) based ASR models have achieved significant progress, yet they generally lack support for multi-speaker scenarios, where the cocktail party problem remains a critical bottleneck for further advancing ASR. Existing TS-ASR methods, including end-to-end architectures with speaker embeddings and latest LLM-based explorations suffer from degraded single-speaker performance and the inability to reject when the target speaker is absent. In this paper, we propose Xiaomi-CocktailASR-1, an LLM-based end-to-end TS-ASR architecture. By utilizing reference speech as voiceprint prompts, it directly transcribes the target speaker's speech without requiring speech separation. Xiaomi-CocktailASR-1 maintains competitive performance in single-speaker scenarios, comparable to mainstream ASR models. It also features a negative sample rejection capability, outputting empty text when the target speaker is absent from the mixed speech. Additionally, Xiaomi-CocktailASR-1 supports a Chain-of-Thought (CoT) reasoning mode to provide explicit reasoning steps. Extensive experiments on various synthetic and real-world multispeaker benchmarks demonstrate that Xiaomi-CocktailASR-1 achieves state-of-the-art performance, effectively addressing the cocktail party problem through a unified architecture that balances multispeaker and single-speaker recognition accuracy, along with rejection capability.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

19 of 26 references.

References · 19

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  3. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
  4. 2020LibriMix: An Open-Source Dataset for Generalizable Speech Separationcited by 154
  5. 2022Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Languagecited by 108
  6. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
  7. 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
  8. 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
  9. 2022Adapting self-supervised models to multi-talker speech recognition using speaker embeddingscited by 18
  10. 2024Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructionscited by 17
  11. 2019Auxiliary Interference Speaker Loss for Target-Speaker Speech Recognitioncited by 16
  12. 2023Extending Whisper with prompt tuning to target-speaker ASRcited by 14
7 more
  1. 2022Summary On The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Grand Challengecited by 11
  2. 2024Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition Systemcited by 11
  3. 2023Conformer-based Target-Speaker Automatic Speech Recognition for Single-Channel Audiocited by 10
  4. 2024Advancing Multi-talker ASR Performance with Large Language Modelscited by 10
  5. 2024Alignment-Free Training for Transducer-based Multi-Talker ASRcited by 4
  6. 2024SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASRcited by 4
  7. 2025Thinking in cocktail party: Chain-of-Thought and reinforcement learning for target speaker automatic speech recognitioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Qwen-Audio-3.0-ASR Technical Report
  2. 2026Speech LLMs are Contextual Reasoning Transcribers
  3. 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs
  4. 2026Are you speaking my languages? On spoken language adherence in multimodal LLMs
  5. 2024Tiny-Align: Bridging Automatic Speech Recognition and Large Language Model on the Edge
  6. 2024Internalizing ASR with Implicit Chain of Thought for Efficient Speech-to-Speech Conversational LLM
  7. 2025MOSA: Mixtures of Simple Adapters Outperform Monolithic Approaches in LLM-based Multilingual ASR
  8. 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLM