mlsanityData to 7 Oct 2026

Prosody-Guided Harmonic Attention for Phase-Coherent Neural Vocoding in the Complex Spectrum

arXiv 2601.14472 ↗First posted 20 Jan 2026cs.SD cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural vocoders are central to speech synthesis; despite their success, most still suffer from limited prosody modeling and inaccurate phase reconstruction. We propose a vocoder that introduces prosody-guided harmonic attention to enhance voiced segment encoding and directly predicts complex spectral components for waveform synthesis via inverse STFT. Unlike mel-spectrogram-based approaches, our design jointly models magnitude and phase, ensuring phase coherence and improved pitch fidelity. To further align with perceptual quality, we adopt a multi-objective training strategy that integrates adversarial, spectral, and phase-aware losses. Experiments on benchmark datasets demonstrate consistent gains over HiFi-GAN and AutoVocoder: F0 RMSE reduced by 22 percent, voiced/unvoiced error lowered by 18 percent, and MOS scores improved by 0.15. These results show that prosody-guided attention combined with direct complex spectrum modeling yields more natural, pitch-accurate, and robust synthetic speech, setting a strong foundation for expressive neural vocoding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

12 of 21 references.

References · 12

  1. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 710
  4. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  5. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  6. 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 308
  7. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
  8. 2018Neural Voice Cloning with a Few Samplescited by 100
  9. 2021UnivNet: A Neural Vocoder with Multi-Resolution Spectrogram Discriminators for High-Fidelity Waveform Generationcited by 71
  10. 2018Robust and fine-grained prosody control of end-to-end speech synthesiscited by 48
  11. 2022Autovocoder: Fast Waveform Generation from a Learned Speech Representation using Differentiable Digital Signal Processingcited by 5
  12. 2025PromptEVC: Controllable Emotional Voice Conversion with Natural Language Promptscited by 1

Built on by

Not cited yet.