mlsanityData to 14 Oct 2026

VIBEVOICE-ASR Technical Report

arXiv 2601.18184 ↗First posted 26 Jan 2026cs.SD cs.AI eess.AScited by 16

Not on the map. Why?

Abstract (arXiv)

This report presents VibeVoice-ASR, a general-purpose speech understanding framework built upon VibeVoice, designed to address the persistent challenges of context fragmentation and multi-speaker complexity in long-form audio (e.g., meetings, podcasts) that remain despite recent advancements in short-form speech recognition. Unlike traditional pipelined approaches that rely on audio chunking, VibeVoice-ASRsupports single-pass processing for up to 60 minutes of audio. It unifies Automatic Speech Recognition, Speaker Diarization, and Timestamping into a single end-to-end generation task. In addition, VibeVoice-ASR supports over 50 languages, requires no explicit language setting, and natively handles code-switching within and across utterances. Furthermore, we introduce a prompt-based context injection mechanism that allows users to supply customized conetxt, significantly improving accuracy on domain-specific terminology and polyphonic character disambiguation.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

17 of 21 references.

References · 17

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2025OpenAI GPT-5 System Cardcited by 989
  5. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  6. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  7. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 181
  8. 2021AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenariocited by 60
  9. 2023Efficient Sequence Transduction by Jointly Predicting Tokens and Durationscited by 58
  10. 2024Multimodal Latent Language Modeling with Next-Token Diffusioncited by 48
  11. 2025VibeVoice Technical Reportcited by 29
  12. 2023AutoPrep: An Automatic Preprocessing Framework for In-the-Wild Speech Datacited by 16
5 more
  1. 2025SpeakerLM: End-to-End Versatile Speaker Diarization and Recognition with Multimodal Large Language Modelscited by 16
  2. 2025Summary on The Multilingual Conversational Speech Language Model Challenge: Datasets, Tasks, Baselines, and Methodscited by 10
  3. 2025Train Short, Infer Long: Speech-LLM Enables Zero-Shot Streamable Joint ASR and Diarization on Long Audiocited by 10
  4. 2026Muse: Towards Reproducible Long-Form Song Generation with Fine-Grained Style Controlcited by 8
  5. 2026TagSpeech: End-to-End Multi-Speaker ASR and Diarization with Fine-Grained Temporal Groundingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoderscited by 2
  2. 2026A Unified and Reproducible Experimentation Framework for Speech Understandingcited by 1
  3. 2026Bagpiper-TTS: Natural Language Guided Universal Speech Synthesiscited by 1
  4. 2026SPEARBench: A Benchmark for Naturalness Evaluation in Streaming Speech-to-Speech Language Modelscited by 1
  5. 2026How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMscited by 1
  6. 2026G-STAR: End-to-End Global Speaker-Tracking Attributed Recognitioncited by 0
  7. 2026Who Spoke What When? Evaluating Spoken Language Models for Conversational ASR with Semantic and Overlap-Aware Metricscited by 0
  8. 2026GigaChat Audio: Time-aware Large Audio Language Modelcited by 0
  9. 2026VibeVoice-ASR-BitNet Technical Reportcited by 0
  10. 2026Leading-Silence Augmentation and Multi-Stage Synthetic Supervision for the Second MLC-SLM Challengecited by 0
  11. 2026HearInContext: A Benchmark for Implicit Context in Speech Recognitioncited by 0
  12. 2026Transsion's Speaker-Attributed Multilingual ASR System for the MLC-SLM 2026 Challengecited by 0
4 more
  1. 2026The Bairong System for MLC-SLM 2026: Dynamic Question-Aware Evidence Routing for Multilingual Conversational Speech Understandingcited by 0
  2. 2026Who Said What, and Will It Be Remembered? Evaluating Persistent Speaker Attribution Across Meetingscited by 0
  3. 2026PERSIST: Who-What-When Memory Across Sessions for Full-Duplex Spoken Dialoguecited by 0
  4. 2026HINTT Submission to the 2nd MLC-SLM Challenge: Comparing Cascaded and Unified Approaches to Diarization and ASRcited by 0