BareWave: Waveform-Native Flow-Matching Text-to-Speech
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Removing intermediate representations and separately trained decoding stages has become an important direction in generative modeling. In text-to-speech, however, high-quality systems are still commonly built through an intermediate acoustic representation before waveform synthesis. In this work, we present BareWave, a fully waveform-native framework for direct text-to-wave generation in flow-matching TTS. We consider this setting to raise three training challenges: raw-waveform modeling lacks a strong pretrained representational scaffold, different stages of training benefit from different noise schedules, and data-space perceptual objectives do not automatically share the temporal structure of the velocity-space flow objective. As a result, direct waveform training is hard to optimize efficiently, hard to push toward a strong final operating point with a fixed recipe, and hard to integrate effective perceptual refinement. Guided by this view, we develop a direct text-to-wave training framework that combines training-time representation alignment, staged noise scheduling, and velocity-aware perceptual alignment (VAPA), while preserving a single waveform-native inference path without pretrained components at test time. Experiments on zero-shot voice cloning show that strong intelligibility, speaker similarity, and naturalness can be achieved under a fully waveform-native inference path, supporting waveform-native flow-matching TTS as a practical direction. Project page with audio demos is available at https://barewave.github.io/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 24 of its 32 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
24 of 32 references.
Closest ancestors · 6
Same direction, newest first
- 2025Accelerating Diffusion-based Text-to-Speech Model Training with Dual Modality Alignment26 May
- 2025WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching20 Mar
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
- 2023E3 TTS: Easy End-to-End Diffusion-based Text to Speech2 Nov
- 2023DiffAR: Denoising Diffusion Autoregressive Model for Raw Speech Waveform Generation2 Oct
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesis21 Sep
Other references · 18
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 340
- 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
- 2024Emilia: An Extensive, Multilingual, and Diverse Speech Dataset for Large-Scale Speech Generationcited by 204
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
6 more
- 2024E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTScited by 152
- 2025PixelDiT: Pixel Diffusion Transformers for Image Generationcited by 83
- 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generationcited by 60
- 2025DiP: Taming Diffusion Models in Pixel Spacecited by 48
- 2024JetFormer: An Autoregressive Generative Model of Raw Images and Textcited by 46
- 2020Wave-Tacotron: Spectrogram-free end-to-end text-to-speech synthesiscited by 38
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
- 2024PeriodWave: Multi-Period Flow Matching for High-Fidelity Waveform Generation
- 2025Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis
- 2026Distill Locally, Schedule Globally: Flow Maps for Few-Step Text-to-Speech
- 2026One-Step Token-to-Waveform Generation with MeanFlow in Latent Space ↗
- 2025Flamed-TTS: Flow Matching Attention-Free Models for Efficient Generating and Dynamic Pacing Zero-shot Text-to-Speech
- 2025OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
- 2026TADA: A Generative Framework for Speech Modeling via Text-Acoustic Dual Alignment