MOSS Transcribe Diarize Technical Report
Not on the map. Why?
Abstract (arXiv)
Speaker-Attributed, Time-Stamped Transcription (SATS) aims to transcribe what is said and to precisely determine the timing of each speaker, which is particularly valuable for meeting transcription. Existing SATS systems rarely adopt an end-to-end formulation and are further constrained by limited context windows, weak long-range speaker memory, and the inability to output timestamps. To address these limitations, we present MOSS Transcribe Diarize, a unified multimodal large language model that jointly performs Speaker-Attributed, Time-Stamped Transcription in an end-to-end paradigm. Trained on extensive real wild data and equipped with a 128k context window for up to 90-minute inputs, MOSS Transcribe Diarize scales well and generalizes robustly. Across comprehensive evaluations, it outperforms state-of-the-art commercial systems on multiple public and in-house benchmarks.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 4 Jan 2026.
Builds on
15 of 24 references.
References · 15
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2019pyannote.audio: neural building blocks for speaker diarizationcited by 175
- 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
- 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 74
- 2020Continuous speech separation: dataset and analysiscited by 73
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 58
- 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
3 more
- 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
- 2025Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audiocited by 10
- 2023Property-Aware Multi-Speaker Data Simulation: A Probabilistic Modelling Technique for Synthetic Data Generationcited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MOSS-Audio Technical Reportcited by 9
- 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflowscited by 1
- 2026G-STAR: End-to-End Global Speaker-Tracking Attributed Recognitioncited by 0
- 2026GigaChat Audio: Time-aware Large Audio Language Modelcited by 0
- 2026LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows14 Sep 2026
- 2026GigaChat Audio: Time-aware Large Audio Language Model11 Jul 2026
- 2026MOSS-Audio Technical Report1 Jun 2026
- 2026G-STAR: End-to-End Global Speaker-Tracking Attributed Recognition11 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR
- 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages
- 2026Beyond Transcripts: A Renewed Perspective on Audio Chaptering
- 2026SPAR-K: Scheduled Periodic Alternating Early Exit for Spoken Language Models
- 2024Nudging: Inference-time Alignment of LLMs via Guided Decoding
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation
- 2026AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following
- 2026HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding