Kinetic-Optimal Scheduling with Moment Correction for Metric-Induced Discrete Flow Matching in Zero-Shot Text-to-Speech
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Metric-induced discrete flow matching (MI-DFM) exploits token-latent geometry for discrete generation, but its practical use is limited by two issues: heuristic schedulers requiring hyperparameter search, and finite-step path-tracking error from its first-order continuous-time Markov chain (CTMC) solver. We address both issues. First, we derive a kinetic-optimal scheduler for prescribed scalar-parameterized probability paths, and instantiate it for MI-DFM as a training-free numerical schedule that traverses the path at constant Fisher-Rao speed. Second, we introduce a finite-step moment correction that adjusts the jump probability while preserving the CTMC jump destination distribution. We validate the resulting method, GibbsTTS, on codec-based zero-shot text-to-speech (TTS). Under controlled comparisons with a unified architecture and large-scale dataset, GibbsTTS achieves the best objective naturalness and is preferred in subjective evaluations over masked discrete generative baselines. Additionally, in comparison with the evaluated state-of-the-art TTS systems, GibbsTTS shows strong speaker similarity, achieving the highest similarity on three of four test sets and ranking second on the fourth. Project page: https://ydqmkkx.github.io/GibbsTTSProject
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 36 of its 41 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
36 of 41 references.
Closest ancestors · 5
Same direction, newest first
- 2026OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models1 Apr
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training23 May
- 2025Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis18 May
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models13 Dec
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
Other references · 31
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020GLU Variants Improve Transformercited by 1,804
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
19 more
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
- 2024Discrete Flow Matchingcited by 317
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 144
- 2026Qwen3-TTS Technical Reportcited by 118
- 2023SoundStorm: Efficient Parallel Audio Generationcited by 114
- 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 90
- 2024Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspectivecited by 57
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
- 2025FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbotcited by 35
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matchingcited by 21
- 2025WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Drivingcited by 16
- 2025Uniform Discrete Diffusion with Metric Path for Video Generationcited by 12
- 2025The Cosine Schedule is Fisher-Rao-Optimal for Masked Discrete Diffusion Modelscited by 11
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DSFlow: Dual Supervision and Step-Aware Architecture for One-Step Flow Matching Speech Synthesis
- 2025DiFlow-TTS: Compact and Low-Latency Zero-Shot Text-to-Speech with Discrete Flow Matching
- 2026Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation
- 2025Flamed-TTS: Flow Matching Attention-Free Models for Efficient Generating and Dynamic Pacing Zero-shot Text-to-Speech
- 2026Distill Locally, Schedule Globally: Flow Maps for Few-Step Text-to-Speech
- 2025Towards Flow-Matching-based TTS without Classifier-Free Guidance
- 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
- 2026Enhancing Flow Matching with A Unified Guidance Framework for Efficient and Robust Speech Synthesis