mlsanityData to 7 Oct 2026

End-to-end Multichannel Speaker-Attributed ASR: Speaker Guided Decoder and Input Feature Analysis

arXiv 2310.10106 ↗First posted 16 Oct 2023cs.CL cs.SD eess.AScited by 3

Not on the map. Why?

Abstract (arXiv)

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To the best of our knowledge, this is the first model that efficiently integrates ASR and speaker identification modules in a multichannel setting. On simulated mixtures of LibriSpeech data, our system reduces the word error rate (WER) by up to 12% and 16% relative compared to previously proposed single-channel and multichannel approaches, respectively. Furthermore, we investigate the impact of different input features, including multichannel magnitude and phase information, on the ASR performance. Finally, our experiments on the AMI corpus confirm the effectiveness of our system for real-world multichannel meeting transcription.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 22 of its 27 references that are in the map. First posted on arXiv 16 Oct 2023.

Builds on

22 of 27 references.

References · 22

  1. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  2. 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 606
  3. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
  4. 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
  5. 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 46
  6. 2019MIMO-SPEECH: End-to-End Multi-Channel Multi-Speaker Speech Recognitioncited by 44
  7. 2020End-to-End Multi-speaker Speech Recognition with Transformercited by 42
  8. 2020Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakerscited by 41
  9. 2021End-to-End Speaker-Attributed ASR with Transformercited by 35
  10. 2021Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphonecited by 33
  11. 2020VoxSRC 2020: The Second VoxCeleb Speaker Recognition Challengecited by 26
  12. 2020Streaming Multi-speaker ASR with RNN-Tcited by 22
10 more
  1. 2020Multi-modal Multi-channel Target Speech Separationcited by 20
  2. 2020ADL-MVDR: All deep learning MVDR beamformer for target speech separationcited by 20
  3. 2021End-to-End Multi-Channel Transformer for Speech Recognitioncited by 17
  4. 2019VoxSRC 2019: The first VoxCeleb Speaker Recognition Challengecited by 13
  5. 2021Streaming Multi-talker Speech Recognition with Joint Speaker Identificationcited by 12
  6. 2021Multi-Speaker ASR Combining Non-Autoregressive Conformer CTC and Conditional Speaker Chaincited by 12
  7. 2021Multi-Channel Multi-Speaker ASR Using 3D Spatial Featurecited by 7
  8. 2022MFCCA:Multi-Frame Cross-Channel attention for multi-speaker ASR in Multi-party meeting scenariocited by 4
  9. 2022A Comparative Study on Multichannel Speaker-Attributed Automatic Speech Recognition in Multi-party Meetingscited by 2
  10. 2022End-to-End Multi-speaker ASR with Independent Vector Analysiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.

  1. 2024Improving Speaker Assignment in Speaker-Attributed ASR for Real Meeting Applicationscited by 3
  2. 2024Joint Beamforming and Speaker-Attributed ASR for Real Distant-Microphone Meeting Transcriptioncited by 0
  3. 2026Exposing the Cost of Deep Learning Audio Developmentcited by 0