Continuous Speech Separation with Conformer
Not on the map. Why?
Abstract (arXiv)
Continuous speech separation plays a vital role in complicated speech related tasks such as conversation transcription. The separation model extracts a single speaker signal from a mixed speech. In this paper, we use transformer and conformer in lieu of recurrent neural networks in the separation system, as we believe capturing global information with the self-attention based method is crucial for the speech separation. Evaluating on the LibriCSS dataset, the conformer separation model achieves state of the art results, with a relative 23.5% word error rate (WER) reduction from bi-directional LSTM (BLSTM) in the utterance-wise evaluation and a 15.4% WER reduction in the continuous evaluation.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 14; 2023: 6; 2024: 2; 2025: 5; 2026: 1.
36 papers.
Sort:
By area:
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognitioncited by 50
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2022TranSpeech: Speech-to-Speech Translation With Bilateral Perturbationcited by 34
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2021Personalized Speech Enhancement: New Models and Comprehensive Evaluationcited by 18
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 18
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
24 more
- 2021VarArray: Array-Geometry-Agnostic Continuous Speech Separationcited by 10
- 2022Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Datacited by 9
- 2023HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methodscited by 8
- 2022A Conformer Based Acoustic Model for Robust Automatic Speech Recognitioncited by 6
- 2021Continuous Speech Separation with Ad Hoc Microphone Arrayscited by 5
- 2021MIMO Self-attentive RNN Beamformer for Multi-speaker Speech Separationcited by 5
- 2022Speech separation with large-scale self-supervised learningcited by 5
- 2023BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASRcited by 5
- 2022Exploring Self-Attention Mechanisms for Speech Separationcited by 4
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separationcited by 4
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancementcited by 3
- 2022Ultra Fast Speech Separation Model with Teacher Student Learningcited by 3
- 2023Leveraging Pretrained ASR Encoders for Effective and Efficient End-to-End Speech Intent Classification and Slot Fillingcited by 3
- 2023On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environmentscited by 3
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correctioncited by 3
- 2022Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Expertscited by 2
- 2023Multi-Dimensional and Multi-Scale Modeling for Speech Separation Optimized by Discriminative Learningcited by 2
- 2025SEAL: Speaker Error Correction using Acoustic-conditioned Large Language Modelscited by 1
- 2025Error Analysis in a Modular Meeting Transcription Systemcited by 1
- 2022DEFORMER: Coupling Deformed Localized Patterns with Global Context for Robust End-to-end Speech Recognitioncited by 0
- 2025Single-Channel Distance-Based Source Separation for Mobile GPU in Outdoor and Indoor Environmentscited by 0
- 2025Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarioscited by 0
- 2025CabinSep: IR-Augmented Mask-Based MVDR for Real-Time In-Car Speech Separation with Distributed Heterogeneous Arrayscited by 0
- 2026Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correctioncited by 0
- 2026Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correction23 Aug 2026
- 2025Error Analysis in a Modular Meeting Transcription System12 Sep 2025
- 2025CabinSep: IR-Augmented Mask-Based MVDR for Real-Time In-Car Speech Separation with Distributed Heterogeneous Arrays1 Sep 2025
- 2025Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarios17 Jun 2025
- 2025SEAL: Speaker Error Correction using Acoustic-conditioned Large Language Models14 Jan 2025
- 2025Single-Channel Distance-Based Source Separation for Mobile GPU in Outdoor and Indoor Environments6 Jan 2025
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correction25 Jun 2024
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription16 Jan 2024
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)30 Oct 2023
- 2023On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments9 Oct 2023
- 2023HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methods15 Sep 2023
- 2023Leveraging Pretrained ASR Encoders for Effective and Efficient End-to-End Speech Intent Classification and Slot Filling13 Jul 2023
24 more
- 2023BA-SOT: Boundary-Aware Serialized Output Training for Multi-Talker ASR23 May 2023
- 2023Multi-Dimensional and Multi-Scale Modeling for Speech Separation Optimized by Discriminative Learning7 Mar 2023
- 2022Improving End-to-end Speech Translation by Leveraging Auxiliary Speech and Text Data4 Dec 2022
- 2022Handling Trade-Offs in Speech Separation with Sparsely-Gated Mixture of Experts11 Nov 2022
- 2022Speech separation with large-scale self-supervised learning9 Nov 2022
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancement22 Sep 2022
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understanding6 Jul 2022
- 2022DEFORMER: Coupling Deformed Localized Patterns with Global Context for Robust End-to-end Speech Recognition4 Jul 2022
- 2022TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation25 May 2022
- 2022Ultra Fast Speech Separation Model with Teacher Student Learning27 Apr 2022
- 2022Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation7 Apr 2022
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings30 Mar 2022
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancement28 Mar 2022
- 2022A Conformer Based Acoustic Model for Robust Automatic Speech Recognition1 Mar 2022
- 2022Exploring Self-Attention Mechanisms for Speech Separation6 Feb 2022
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Training2 Feb 2022
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancement17 Nov 2021
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing26 Oct 2021
- 2021Personalized Speech Enhancement: New Models and Comprehensive Evaluation18 Oct 2021
- 2021VarArray: Array-Geometry-Agnostic Continuous Speech Separation12 Oct 2021
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio6 Jul 2021
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognition10 Jun 2021
- 2021MIMO Self-attentive RNN Beamformer for Multi-speaker Speech Separation17 Apr 2021
- 2021Continuous Speech Separation with Ad Hoc Microphone Arrays3 Mar 2021
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
- 2021PARP: Prune, Adjust and Re-Prune for Self-Supervised Speech Recognitioncited by 50
- 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
- 2022Streaming Multi-Talker ASR with Token-Level Serialized Output Trainingcited by 37
- 2022TranSpeech: Speech-to-Speech Translation With Bilateral Perturbationcited by 34
- 2022CMGAN: Conformer-Based Metric-GAN for Monaural Speech Enhancementcited by 22
- 2021Personalized Speech Enhancement: New Models and Comprehensive Evaluationcited by 18
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcriptioncited by 18
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2021A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audiocited by 10
12 most cited of 35 All 35 (JSON)
- 2026Mitigating Speaker Leakage in Cascaded Multi-talker ASR with Diarization-based Transcript Correction23 Aug 2026
- 2025Error Analysis in a Modular Meeting Transcription System12 Sep 2025
- 2025CabinSep: IR-Augmented Mask-Based MVDR for Real-Time In-Car Speech Separation with Distributed Heterogeneous Arrays1 Sep 2025
- 2025Improving Practical Aspects of End-to-End Multi-Talker Speech Recognition for Online and Offline Scenarios17 Jun 2025
- 2025SEAL: Speaker Error Correction using Acoustic-conditioned Large Language Models14 Jan 2025
- 2025Single-Channel Distance-Based Source Separation for Mobile GPU in Outdoor and Indoor Environments6 Jan 2025
- 2024AG-LSEC: Audio Grounded Lexical Speaker Error Correction25 Jun 2024
- 2024NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription16 Jan 2024
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)30 Oct 2023
- 2023On Time Domain Conformer Models for Monaural Speech Separation in Noisy Reverberant Acoustic Environments9 Oct 2023
- 2023HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methods15 Sep 2023
- 2023Leveraging Pretrained ASR Encoders for Effective and Efficient End-to-End Speech Intent Classification and Slot Filling13 Jul 2023
12 newest of 35 All 35 (JSON)