G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition
Not on the map. Why?
Abstract (arXiv)
We study timestamped speaker-attributed automatic speech recognition (SA-ASR) for long-form, multi-party speech with overlap. In this setting, chunk-wise inference must preserve meeting-level speaker identity consistency while producing time-stamped, speaker-labeled transcripts. Prior Speech-LLM systems tend to prioritize either local diarization or global labeling, lacking the ability to jointly model fine-grained temporal boundaries and robust cross-chunk identity linking. We propose G-STAR, an end-to-end framework that couples a cache-conditioned speaker-tracking module with a Speech-LLM transcription backbone. The tracker provides structured speaker cues with temporal grounding, and the LLM generates attributed text conditioned on these cues. G-STAR supports component-wise optimization and joint end-to-end training, enabling flexible learning under heterogeneous supervision and domain shift. Under chunk-wise decoding protocols, experiments on both oracle-segmented local evaluation and full-meeting global evaluation show strong speaker-attributed transcription performance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
25 of 31 references.
References · 25
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2025Qwen3-Omni Technical Reportcited by 497
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 219
- 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
- 2024Recent Advances in Speech Language Models: A Surveycited by 87
- 2024A Survey on Speech Large Language Models for Understandingcited by 71
- 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
- 2019Joint Speech Recognition and Speaker Diarization via Sequence Transductioncited by 49
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 46
- 2020Streaming end-to-end multi-talker speech recognitioncited by 29
13 more
- 2018Recognizing Overlapped Speech in Meetings: A Multichannel Separation Approach Using Neural Networkscited by 23
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 16
- 2026VIBEVOICE-ASR Technical Reportcited by 16
- 2022Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddingscited by 14
- 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10
- 2025Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audiocited by 10
- 2023SURT 2.0: Advances in Transducer-based Multi-talker Speech Recognitioncited by 8
- 2025Speaker Targeting via Self-Speaker Adaptation for Multi-talker ASRcited by 8
- 2025Streaming Sortformer: Speaker Cache-Based Online Speaker Diarization with Arrival-Time Orderingcited by 8
- 2026TagSpeech: End-to-End Multi-Speaker ASR and Diarization with Fine-Grained Temporal Groundingcited by 5
- 2024On Speaker Attribution with SURTcited by 4
- 2026MOSS Transcribe Diarize Technical Reportcited by 4
- 2025WEST: LLM based Speech Toolkit for Speech Understanding, Generation, and Interactioncited by 1
Built on by
Not cited yet.