Vocal Intensity Conversion with Continuous SPL Control via Adversarial Training
Not on the map. Why?
Abstract (arXiv)
Vocal intensity conversion renders a recorded utterance at a different vocal intensity, rather than simply scaling its amplitude, while preserving its content and speaker identity. Existing systems control intensity through a reference utterance or a few discrete categories. Instead, we control the conversion with any target sound pressure level (SPL) on a continuous dB scale. A lightweight converter, trained as a conditional cycle-consistent GAN without parallel data, transforms the features of a frozen speech encoder, from which a pretrained vocoder resynthesizes the speech. We compare three representations, log-mel spectrograms, WavLM, and SpeechTokenizer, and introduce an objective protocol that measures the achieved intensity change against the target one on a calibrated corpus. With WavLM, the converter achieves a measured 83% of the target change in intensity and also shifts the fundamental frequency. A perceptual evaluation confirms that perceived vocal intensity increases with the target level on amplitude-normalized stimuli.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
12 of 33 references.
References · 12
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2016Least Squares Generative Adversarial Networkscited by 1,001
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
- 2023Voice Conversion With Just Nearest Neighborscited by 68
Built on by
Not cited yet.