PitchFlower: A flow-based neural audio codec with pitch controllability
Not on the map. Why?
Abstract (arXiv)
We present PitchFlower, a flow-based neural audio codec with explicit pitch controllability. Our approach promotes pitch disentanglement through a simple perturbation: during training, F0 contours are flattened and randomly shifted at the input, while the true F0 is provided as conditioning to regenerate the original audio. A vector-quantization bottleneck prevents pitch recovery, and a flow-based decoder generates high quality audio. Experiments show that PitchFlower achieves accurate pitch control at the level of DSP baselines but at much higher audio quality, and performs on par with state-of-the-art neural approaches. Notably, despite using WORLD-transformed audio for training, our method filters out the vocoder's inherent artifacts, revealing a strong resilience of deep generative modeling to input degradation. This finding suggests that our framework provides a simple and extensible path that could be extended to other speech attributes.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 29 Oct 2025.
Builds on
24 of 31 references.
References · 24
- 2017Attention Is All You Needcited by 60,361
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2022A ConvNet for the 2020scited by 3,579
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
- 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
12 more
- 2019AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Losscited by 192
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
- 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 101
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual qualitycited by 15
- 2022Source-Filter HiFi-GAN: Fast and Pitch Controllable High-Fidelity Neural Vocodercited by 11
- 2024Fine-Grained and Interpretable Neural Speech Editingcited by 6
- 2021KaraTuner: Towards end to end natural pitch correction for singing voice in karaokecited by 4
- 2024PeriodGrad: Towards Pitch-Controllable Neural Vocoder Based on a Diffusion Probabilistic Modelcited by 3
- 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Ratescited by 3
- 2025Neurodyne: Neural Pitch Manipulation with Representation Learning and Cycle-Consistency GANcited by 2
- 2025Fast-VGAN: Lightweight Voice Conversion with Explicit Control of F0 and Duration Parameterscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025CodecSep: Prompt-Driven Universal Sound Separation on Neural Audio Codec Latents
- 2024Gull: A Generative Multifunctional Audio Codec
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space
- 2026GS-Codec: A Gaussian-Splatting Bottleneck for Neural Audio Coding
- 2026One-Step Token-to-Waveform Generation with MeanFlow in Latent Space ↗
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis
- 2026EuleroDec: A Complex-Valued RVQ-VAE for Efficient and Robust Audio Coding
- 2025QINCODEC: Neural Audio Compression with Implicit Neural Codebooks