Xiaomi-CocktailASR-1 Technical Report
Not on the map. Why?
Abstract (arXiv)
Recently, large language model (LLM) based ASR models have achieved significant progress, yet they generally lack support for multi-speaker scenarios, where the cocktail party problem remains a critical bottleneck for further advancing ASR. Existing TS-ASR methods, including end-to-end architectures with speaker embeddings and latest LLM-based explorations suffer from degraded single-speaker performance and the inability to reject when the target speaker is absent. In this paper, we propose Xiaomi-CocktailASR-1, an LLM-based end-to-end TS-ASR architecture. By utilizing reference speech as voiceprint prompts, it directly transcribes the target speaker's speech without requiring speech separation. Xiaomi-CocktailASR-1 maintains competitive performance in single-speaker scenarios, comparable to mainstream ASR models. It also features a negative sample rejection capability, outputting empty text when the target speaker is absent from the mixed speech. Additionally, Xiaomi-CocktailASR-1 supports a Chain-of-Thought (CoT) reasoning mode to provide explicit reasoning steps. Extensive experiments on various synthetic and real-world multispeaker benchmarks demonstrate that Xiaomi-CocktailASR-1 achieves state-of-the-art performance, effectively addressing the cocktail party problem through a unified architecture that balances multispeaker and single-speaker recognition accuracy, along with rejection capability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
19 of 26 references.
References · 19
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 364
- 2020LibriMix: An Open-Source Dataset for Generalizable Speech Separationcited by 154
- 2022Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Languagecited by 108
- 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
- 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
- 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
- 2022Adapting self-supervised models to multi-talker speech recognition using speaker embeddingscited by 18
- 2024Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructionscited by 17
- 2019Auxiliary Interference Speaker Loss for Target-Speaker Speech Recognitioncited by 16
- 2023Extending Whisper with prompt tuning to target-speaker ASRcited by 14
7 more
- 2022Summary On The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Grand Challengecited by 11
- 2024Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition Systemcited by 11
- 2023Conformer-based Target-Speaker Automatic Speech Recognition for Single-Channel Audiocited by 10
- 2024Advancing Multi-talker ASR Performance with Large Language Modelscited by 10
- 2024Alignment-Free Training for Transducer-based Multi-Talker ASRcited by 4
- 2024SQ-Whisper: Speaker-Querying based Whisper Model for Target-Speaker ASRcited by 4
- 2025Thinking in cocktail party: Chain-of-Thought and reinforcement learning for target speaker automatic speech recognitioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Asymmetric Classifier-Free Guidance for Target-Speaker ASR24 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Qwen-Audio-3.0-ASR Technical Report
- 2026Speech LLMs are Contextual Reasoning Transcribers
- 2023AudioChatLlama: Towards General-Purpose Speech Abilities for LLMs
- 2026Are you speaking my languages? On spoken language adherence in multimodal LLMs
- 2024Tiny-Align: Bridging Automatic Speech Recognition and Large Language Model on the Edge
- 2024Internalizing ASR with Implicit Chain of Thought for Efficient Speech-to-Speech Conversational LLM
- 2025MOSA: Mixtures of Simple Adapters Outperform Monolithic Approaches in LLM-based Multilingual ASR
- 2024Boosting Code-Switching ASR with Mixture of Experts Enhanced Speech-Conditioned LLM