mlsanityData to 14 Oct 2026

SAGE-LD: Towards Scalable and Generalizable End-to-End Language Diarization via Simulated Data Augmentation

arXiv 2510.00582 ↗First posted 1 Oct 2025cs.CL cs.AI cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a neural spoken language diarization model that supports an unconstrained span of languages within a single framework. Our approach integrates a learnable query-based architecture grounded in multilingual awareness, with large-scale pretraining on simulated code-switching data. By jointly leveraging these two components, our method overcomes the limitations of conventional approaches in data scarcity and architecture optimization, and generalizes effectively to real-world multilingual settings across diverse environments. Experimental results demonstrate that our approach achieves state-of-the-art performance on several language diarization benchmarks, with a relative performance improvement of 23% to 52% over previous methods. We believe that this work not only advances research in language diarization but also establishes a foundational framework for code-switching speech technologies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

20 of 28 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  3. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  5. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  6. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  7. 2021Layer-wise Analysis of a Self-supervised Speech Representation Modelcited by 298
  8. 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 172
  9. 2023Voice Conversion With Just Nearest Neighborscited by 68
  10. 2018Building and Evaluation of a Real Room Impulse Response Datasetcited by 43
  11. 2024Zero-shot Voice Conversion with Diffusion Transformerscited by 43
  12. 2022Reducing Language confusion for Code-switching Speech Recognition with Token-level Language Diarizationcited by 29
8 more
  1. 2022A Survey of Multilingual Models for Automatic Speech Recognitioncited by 21
  2. 2024FLEURS-R: A Restored Multilingual Speech Corpus for Generation Taskscited by 13
  3. 2023MERLIon CCS Challenge: A English-Mandarin code-switching child-directed speech corpus for language identification and diarizationcited by 9
  4. 2024The Second DISPLACE Challenge : DIarization of SPeaker and LAnguage in Conversational Environmentscited by 6
  5. 2023Fine-Tuned Self-Supervised Speech Representations for Language Diarization in Multilingual Code-Switched Speechcited by 4
  6. 2024EEND-M2F: Masked-attention mask transformers for speaker diarizationcited by 3
  7. 2024TalTech-IRIT-LIS Speaker and Language Diarization Systems for DISPLACE 2024cited by 2
  8. 2025UniCoM: A Universal Code-Switching Speech Generatorcited by 2

Built on by

Not cited yet.