mlsanityData to 7 Oct 2026

StarTSE: Towards Streaming Target Speaker Extraction via Chunk-wise Interleaved Splicing of Autoregressive Language Model

arXiv 2604.19635 ↗First posted 21 Apr 2026cs.SD cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

While generative models have set new benchmarks for Target Speaker Extraction (TSE), their inherent reliance on global context precludes deployment in real-time applications. Direct adaptation to streaming scenarios often leads to catastrophic inference performance degradation due to the severe mismatch between training and streaming inference. To bridge this gap, we present the first autoregressive (AR) models tailored for streaming TSE. Our approach introduces a Chunk-wise Interleaved Splicing Paradigm that ensures highly efficient and stable streaming inference. To ensure the coherence between the extracted speech segments, we design a historical context refinement mechanism that mitigates boundary discontinuities by leveraging historical information. Experiments on Libri2Mix show that while AR generative baseline exhibits performance degradation at low latencies, our approach maintains 100% stability and superior intelligibility. Furthermore, our streaming results are comparable to or even surpass offline baselines. Additionally, our model achieves a Real-Time-Factor (RTF) of 0.248 on consumer-level GPUs. This work provides empirical evidence that AR generative backbones are viable for latency-sensitive applications through the Chunk-wise Interleaved Splicing Paradigm.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 22 references that are in the map. First posted on arXiv 21 Apr 2026.

Builds on

20 of 22 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  4. 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
  5. 2021DNSMOS P.835: A Non-Intrusive Perceptual Objective Speech Quality Metric to Evaluate Noise Suppressorscited by 165
  6. 2020LibriMix: An Open-Source Dataset for Generalizable Speech Separationcited by 154
  7. 2022Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkitcited by 92
  8. 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
  9. 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
  10. 2024SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metricscited by 38
  11. 2020SpEx+: A Complete Time Domain Speaker Extraction Networkcited by 33
  12. 2023Neural Target Speech Extraction: An Overviewcited by 33
8 more
  1. 2020VoiceFilter-Lite: Streaming Targeted Voice Separation for On-Device Speech Recognitioncited by 29
  2. 2023Target Speech Extraction with Conditional Diffusion Modelcited by 15
  3. 2023DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extractioncited by 12
  4. 2024SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformercited by 11
  5. 2024TSELM: Target Speaker Extraction using Discrete Tokens and Language Modelscited by 10
  6. 2025SoloSpeech: Enhancing Intelligibility and Quality in Target Speech Extraction through a Cascaded Generative Pipelinecited by 9
  7. 2024WeSep: A Scalable and Flexible Toolkit Towards Generalizable Target Speaker Extractioncited by 8
  8. 2025LauraTSE: Target Speaker Extraction using Auto-Regressive Decoder-Only Language Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.