GigaSpeech: An Evolving, Multi-domain ASR Corpus with 10,000 Hours of Transcribed Audio
Not on the map. Why?
Abstract (arXiv)
This paper introduces GigaSpeech, an evolving, multi-domain English speech recognition corpus with 10,000 hours of high quality labeled audio suitable for supervised training, and 40,000 hours of total audio suitable for semi-supervised and unsupervised training. Around 40,000 hours of transcribed audio is first collected from audiobooks, podcasts and YouTube, covering both read and spontaneous speaking styles, and a variety of topics, such as arts, science, sports, etc. A new forced alignment and segmentation pipeline is proposed to create sentence segments suitable for speech recognition training, and to filter out segments with low-quality transcription. For system training, GigaSpeech provides five subsets of different sizes, 10h, 250h, 1000h, 2500h, and 10000h. For our 10,000-hour XL training subset, we cap the word error rate at 4% during the filtering/validation stage, and for all our other smaller training subsets, we cap it at 0%. The DEV and TEST evaluation sets, on the other hand, are re-processed by professional human transcribers to ensure high transcription quality. Baseline systems are provided for popular speech recognition toolkits, namely Athena, ESPnet, Kaldi and Pika.
Key facts. Cited by 391 papers in the map (data through 7 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 13 Jun 2021.
Builds on
10 of 19 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2018ESPnet: End-to-End Speech Processing Toolkitcited by 554
- 2018TED-LIUM 3: twice as much data and corpus repartition for experiments on speaker adaptationcited by 224
- 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 210
- 2020Recent Developments on ESPnet Toolkit Boosted by Conformercited by 132
- 2021SPGISpeech: 5,000 hours of transcribed financial audio for fully formatted end-to-end speech recognitioncited by 77
- 2017English Conversational Telephone Speech Recognition by Humans and Machinescited by 40
- 2019Minimum Bayes Risk Training of RNN-Transducer for End-to-End Speech Recognitioncited by 23
Built on by
Citing papers per year: 2021: 11; 2022: 24; 2023: 55; 2024: 106; 2025: 105; 2026: 90.
391 papers.
Sort:
By area:
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2024AnyGPT: Unified Multimodal LLM with Discrete Sequence Modelingcited by 213
- 2025Kimi-Audio Technical Reportcited by 210
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
38 more
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
- 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 124
- 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 101
- 2025Step-Audio 2 Technical Reportcited by 101
- 2021The People's Speech: A Large-Scale Diverse English Speech Recognition Dataset for Commercial Usagecited by 98
- 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
- 2023Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labellingcited by 87
- 2024An Embarrassingly Simple Approach for LLM with Strong ASR Capacitycited by 86
- 2024Recent Advances in Speech Language Models: A Surveycited by 85
- 2023Connecting Speech Encoder and Large Language Model for ASRcited by 79
- 2025Ola: Pushing the Frontiers of Omni-Modal Language Modelcited by 79
- 2023LauraGPT: Listen, Attend, Understand, and Regenerate Audio with GPTcited by 77
- 2023BLSP: Bootstrapping Language-Speech Pre-training via Behavior Alignment of Continuation Writingcited by 75
- 2024OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformercited by 74
- 2023Generative Speech Recognition Error Correction with Large Language Models and Task-Activating Promptingcited by 71
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 69
- 2024mHuBERT-147: A Compact Multilingual HuBERT Modelcited by 64
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2023What Do Self-Supervised Speech Models Know About Words?cited by 62
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 62
- 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
- 2023Whispering LLaMA: A Cross-Modal Generative Error Correction Framework for Speech Recognitioncited by 56
- 2023Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Biascited by 51
- 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
- 2024Consent in Crisis: The Rapid Decline of the AI Data Commonscited by 45
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2024EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotionscited by 44
- 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 43
- 2023Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Datacited by 42
- 2023Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Studycited by 42
- 2024SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Soundcited by 42
- 2023HyPoradise: An Open Baseline for Generative Speech Recognition with Large Language Modelscited by 41
- 2025Voxtralcited by 41
50 most cited of 391 All 391 (JSON)
- 2026AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models1 Oct 2026
- 2026Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization1 Oct 2026
- 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR28 Sep 2026
- 2026FuseAlign: Forced Alignment in the Wild27 Sep 2026
- 2026Acoustic Progress Propagation for Long-Horizon Speculative Decoding in ASR27 Sep 2026
- 2026How to Reduce Whisper Hallucination26 Sep 2026
- 2026mu-bench: A Multilingual Utterance Transcription Benchmark25 Sep 2026
- 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech24 Sep 2026
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models18 Sep 2026
- 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection17 Sep 2026
- 2026Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR16 Sep 2026
- 2026ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding10 Sep 2026
38 more
- 2026X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation10 Sep 2026
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants9 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
- 2026Where Does the Sound Go? Tracing Acoustic Information Loss in Audio-Conditioned LLMs5 Sep 2026
- 2026Listen to the Latents: Self-Correcting Speech Recognition in Large Audio Language Models Through Hidden-State Interactions31 Aug 2026
- 2026VoiceCodeBench: Evaluating Exact Structured-Token Recovery in Automatic Speech Recognition28 Aug 2026
- 2026Do Spoken Language Models Hear Speech as They Read Text? Bridging Structural Gaps Between Speech and Text24 Aug 2026
- 2026Using the Mimi codec for metalinguistic representations16 Aug 2026
- 2026Phoenix TTS: High-Fidelity Synthesis and Voice Conversion via Flow-Matching-Driven Speech Tokenization12 Aug 2026
- 2026X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction11 Aug 2026
- 2026Whisper-Aware LLM: Self-Supervised Uncertainty Learning for Robust Whispered Speech Recognition11 Aug 2026
- 2026Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing5 Aug 2026
- 2026Teffic-Audio: Tell Fact from Fiction30 Jul 2026
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach30 Jul 2026
- 2026MMAC: A Massive Multi-dimensional Benchmark for Audio Captioning29 Jul 2026
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos17 Jul 2026
- 2026Emputation: Identification-Guided Neural Imputation Framework6 Jul 2026
- 2026DuplexChat: Constructing Speaker-Separated Full-Duplex Dialogue Speech at Scale for Spoken Dialogue Language Modeling6 Jul 2026
- 2026Preference-ASR: A Preference-Aware Test Set for Benchmarking ASR in the Era of Speech LLMs28 Jun 2026
- 2026Bagpiper-TTS: Natural Language Guided Universal Speech Synthesis22 Jun 2026
- 2026Augmenting Dysarthric Speech Severity Assessment with MOS Supervision17 Jun 2026
- 2026SpeechDx: A Multi-Task Benchmark for Clinical Speech AI15 Jun 2026
- 2026The Holistic Storage of Verb+Up Phrases in Text-based and Audio-based Language Models12 Jun 2026
- 2026Continuous Audio Thinking for Large Audio Language Models5 Jun 2026
- 2026USAD 2.0: Scaling Representation Distillation for Universal Audio Understanding4 Jun 2026
- 2026MURMUR: An Efficient Inference System for Long-Form ASR31 May 2026
- 2026PolySpeech-100: A Large-Scale Benchmark for Speech Understanding Across 100+ Languages and Dialects31 May 2026
- 2026UniAudio-Token: Empowering Semantic Speech Tokenizers with General Audio Perception29 May 2026
- 2026HoliTok: A Continuous Holistic Tokenization with Robust Dual Capabilities of Speech Generation and Understanding28 May 2026
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition27 May 2026
- 2026Proactive for Uncertainty: Cause-Aware Error Diagnosis and Interactive Clarification for Spoken Dialogue Systems25 May 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching21 May 2026
- 2026Sometin Beta Pass Notin: Improving Multilingual ASR for Nigerian Languages via Knowledge Distillation18 May 2026
- 2026A Survey of Automated Presentation Coaching: Systems, Methods, and Open Challenges11 May 2026
- 2026How Should LLMs Listen While Speaking? A Study of User-Stream Routing in Full-Duplex Spoken Dialogue11 May 2026
- 2026WorldSpeech: A Multilingual Speech Corpus from Around the World9 May 2026
50 newest of 391 All 391 (JSON)
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesiscited by 39
- 2024SpeechGPT-Gen: Scaling Chain-of-Information Speech Generationcited by 36
- 2024DiTTo-TTS: Diffusion Transformers for Scalable Text-to-Speech without Domain-Specific Factorscited by 31
- 2024FlashSpeech: Efficient Zero-Shot Speech Synthesiscited by 22
- 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matchingcited by 17
- 2025IMPACT: Iterative Mask-based Parallel Decoding for Text-to-Audio Generation with Diffusion Modelingcited by 6
- 2024DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesiscited by 5
- 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matchingcited by 4
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 2
- 2025Improved Intelligibility of Dysarthric Speech using Conditional Flow Matchingcited by 1
- 2026DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusioncited by 1
12 most cited of 17 All 17 (JSON)
- 2026Phoenix TTS: High-Fidelity Synthesis and Voice Conversion via Flow-Matching-Driven Speech Tokenization12 Aug 2026
- 2026Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing5 Aug 2026
- 2026RobustSpeechFlow: Learning Robust Text-to-Speech Trajectories via Augmentation-based Contrastive Flow Matching21 May 2026
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model9 Mar 2026
- 2026DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion14 Jan 2026
- 2025DiFlow-TTS: Compact and Low-Latency Zero-Shot Text-to-Speech with Discrete Flow Matching11 Sep 2025
- 2025Improved Intelligibility of Dysarthric Speech using Conditional Flow Matching19 Jun 2025
- 2025IMPACT: Iterative Mask-based Parallel Decoding for Text-to-Audio Generation with Diffusion Modeling31 May 2025
- 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching26 May 2025
- 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching19 May 2025
- 2025MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis26 Feb 2025
- 2024Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR16 Oct 2024
12 newest of 17 All 17 (JSON)
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2024AnyGPT: Unified Multimodal LLM with Discrete Sequence Modelingcited by 213
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interactioncited by 64
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generationcited by 33
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identificationcited by 13
- 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusioncited by 9
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processingcited by 7
- 2026FastSLM: Hierarchical Temporal Abstraction for Efficient Long-Form Speech Adaptationcited by 0
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistantscited by 0
- 2026S3-Bench: Evaluating Speech Interaction Models as Scientific Voice Assistants9 Sep 2026
- 2026MiniCPM-o 4.5: Towards Real-Time Full-Duplex Omni-Modal Interaction30 Apr 2026
- 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion6 Mar 2026
- 2026SLAM-LLM: A Modular, Open-Source Multimodal Large Language Model Framework and Best Practice for Speech, Language, Audio and Music Processing14 Jan 2026
- 2026FastSLM: Hierarchical Temporal Abstraction for Efficient Long-Form Speech Adaptation8 Jan 2026
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction3 Jan 2025
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions12 Dec 2024
- 2024SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation27 Nov 2024
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identification11 Nov 2024
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLM9 Aug 2024
- 2024AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling19 Feb 2024
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities18 May 2023
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmarkcited by 101
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesiscited by 69
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentationcited by 10
- 2026MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audiocited by 2
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videoscited by 2
- 2026A Unified Spoken Language Model with Injected Emotional-Attribution Thinking for Human-like Interactioncited by 1
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMscited by 1
- 2026Continuous Audio Thinking for Large Audio Language Modelscited by 1
- 2026AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Modelscited by 0
- 2026AURAL: Adaptive Latent Reasoning with Joint Chunk for Speech Language Models1 Oct 2026
- 2026Audio-Visual Flamingo: Open Audio-Visual Intelligence for Long and Complex Videos17 Jul 2026
- 2026Continuous Audio Thinking for Large Audio Language Models5 Jun 2026
- 2026MedMosaic: A Challenging Large Scale Benchmark of Diverse Medical Audio1 May 2026
- 2026Rethinking Entropy Allocation in LLM-based ASR: Understanding the Dynamics between Speech Encoders and LLMs9 Apr 2026
- 2026A Unified Spoken Language Model with Injected Emotional-Attribution Thinking for Human-like Interaction8 Jan 2026
- 2025Towards Omnimodal Expressions and Reasoning in Referring Audio-Visual Segmentation30 Jul 2025
- 2025MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark5 Jun 2025
- 2025Llasa: Scaling Train-Time and Inference-Time Compute for Llama-based Speech Synthesis6 Feb 2025
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
- 2024NeKo: Cross-Modality Post-Recognition Error Correction with Tasks-Guided Mixture-of-Experts Language Modelcited by 7
- 2025End-to-end Listen, Look, Speak and Actcited by 3
- 2025BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASRcited by 2
- 2024UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognitioncited by 1
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Modelscited by 0
- 2026Eureka-Audio: Triggering Audio Intelligence in Compact Language Models15 Feb 2026
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data16 Nov 2025
- 2025End-to-end Listen, Look, Speak and Act19 Oct 2025
- 2025BLR-MoE: Boosted Language-Routing Mixture of Experts for Domain-Robust Multilingual E2E ASR22 Jan 2025
- 2024UME: Upcycling Mixture-of-Experts for Scalable and Efficient Automatic Speech Recognition23 Dec 2024
- 2024NeKo: Cross-Modality Post-Recognition Error Correction with Tasks-Guided Mixture-of-Experts Language Model8 Nov 2024
- 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agentcited by 15
- 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perceptioncited by 2
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluationcited by 2
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognitioncited by 1
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approachcited by 1
- 2026AgenticASR: Refining Speech Recognition in Real-World Scenarios via an Agentic Approach30 Jul 2026
- 2026Towards Human-Like Interactive Speech Recognition With Agentic Correction and Semantic Evaluation28 May 2026
- 2026Interactive ASR: Towards Human-Like Interaction and Semantic Coherence Evaluation for Agentic Speech Recognition10 Apr 2026
- 2026Speech-Hands: A Self-Reflection Voice Agentic Approach to Speech Recognition and Audio Reasoning with Omni Perception14 Jan 2026
- 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agent6 Aug 2024
- 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedbackcited by 38
- 2024Preference Alignment Improves Language Model-Based TTScited by 21
- 2024Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedbackcited by 19
- 2025SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translationcited by 13
- 2024Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimizationcited by 10
- 2025SeqPO-SiMT: Sequential Policy Optimization for Simultaneous Machine Translation27 May 2025
- 2024Align Anything: Training All-Modality Models to Follow Instructions with Language Feedback20 Dec 2024
- 2024Preference Alignment Improves Language Model-Based TTS19 Sep 2024
- 2024Robust Zero-Shot Text-to-Speech Synthesis with Reverse Inference Optimization2 Jul 2024
- 2024Enhancing Zero-shot Text-to-Speech Synthesis with Human Feedback2 Jun 2024
- 2024Exploring the Capability of Mamba in Speech Applicationscited by 19
- 2024Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognitioncited by 5
- 2025DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming Capabilitiescited by 5
- 2025Speak, Edit, Repeat: High-Fidelity Voice Editing and Zero-Shot TTS with Cross-Attentive Mambacited by 0
- 2025Speak, Edit, Repeat: High-Fidelity Voice Editing and Zero-Shot TTS with Cross-Attentive Mamba6 Oct 2025
- 2025DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming Capabilities16 Feb 2025
- 2024Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognition11 Nov 2024
- 2024Exploring the Capability of Mamba in Speech Applications24 Jun 2024
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2022Self-Supervised Speech Representation Learning: A Reviewcited by 258
- 2025Kimi-Audio Technical Reportcited by 210
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 200
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 189
- 2023Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modelingcited by 166
- 2024AudioBench: A Universal Benchmark for Audio Large Language Modelscited by 124
- 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 109
12 most cited of 323 All 323 (JSON)
- 2026Q-SPT: Learnable Query-Based Compression for Low-Frame-Rate Speech Tokenization1 Oct 2026
- 2026CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR28 Sep 2026
- 2026FuseAlign: Forced Alignment in the Wild27 Sep 2026
- 2026How to Reduce Whisper Hallucination26 Sep 2026
- 2026mu-bench: A Multilingual Utterance Transcription Benchmark25 Sep 2026
- 2026YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech24 Sep 2026
- 2026Vox-Infinity: Benchmarking the Limits of Long-Context Spoken Language Models18 Sep 2026
- 2026CoReLoop: Parameter-Efficient Controlled Recurrent Refinement for Audio Deepfake Detection17 Sep 2026
- 2026Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR16 Sep 2026
- 2026ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding10 Sep 2026
- 2026X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation10 Sep 2026
- 2026X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR8 Sep 2026
12 newest of 323 All 323 (JSON)