mlsanityData to 7 Oct 2026

MOSS Transcribe Diarize Technical Report

arXiv 2601.01554 ↗First posted 4 Jan 2026cs.SD cs.AI eess.AScited by 4

Not on the map. Why?

Abstract (arXiv)

Speaker-Attributed, Time-Stamped Transcription (SATS) aims to transcribe what is said and to precisely determine the timing of each speaker, which is particularly valuable for meeting transcription. Existing SATS systems rarely adopt an end-to-end formulation and are further constrained by limited context windows, weak long-range speaker memory, and the inability to output timestamps. To address these limitations, we present MOSS Transcribe Diarize, a unified multimodal large language model that jointly performs Speaker-Attributed, Time-Stamped Transcription in an end-to-end paradigm. Trained on extensive real wild data and equipped with a 128k context window for up to 90-minute inputs, MOSS Transcribe Diarize scales well and generalizes robustly. Across comprehensive evaluations, it outperforms state-of-the-art commercial systems on multiple public and in-house benchmarks.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 4 Jan 2026.

Builds on

15 of 24 references.

References · 15

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  3. 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
  4. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  5. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  6. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 175
  7. 2020Serialized Output Training for End-to-End Overlapped Speech Recognitioncited by 87
  8. 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 74
  9. 2020Continuous speech separation: dataset and analysiscited by 73
  10. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  11. 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 58
  12. 2024DiarizationLM: Speaker Diarization Post-Processing with Large Language Modelscited by 16
3 more
  1. 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 14
  2. 2025Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audiocited by 10
  3. 2023Property-Aware Multi-Speaker Data Simulation: A Probabilistic Modelling Technique for Synthetic Data Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Speaker-Reasoner: Scaling Interaction Turns and Reasoning Patterns for Timestamped Speaker-Attributed ASR
  2. 2026Indic DiarBench: A Multilingual Joint Diarization and ASR Benchmark for Indian Languages
  3. 2026Beyond Transcripts: A Renewed Perspective on Audio Chaptering
  4. 2026SPAR-K: Scheduled Periodic Alternating Early Exit for Spoken Language Models
  5. 2024Nudging: Inference-time Alignment of LLMs via Guided Decoding
  6. 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation
  7. 2026AnyAudio-Judge: A Dynamic Rubric-Based Benchmark and Evaluator for Audio Instruction Following
  8. 2026HEAR Who Said What: Unlocking Speaker-Attributed Reasoning via Counterfactual Voice Grounding