mlsanityData to 7 Oct 2026

Spiking Vocos: An Energy-Efficient Neural Vocoder

arXiv 2509.13049 ↗First posted 16 Sep 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite the remarkable progress in the synthesis speed and fidelity of neural vocoders, their high energy consumption remains a critical barrier to practical deployment on computationally restricted edge devices. Spiking Neural Networks (SNNs), widely recognized for their high energy efficiency due to their event-driven nature, offer a promising solution for low-resource scenarios. In this paper, we propose Spiking Vocos, a novel spiking neural vocoder with ultra-low energy consumption, built upon the efficient Vocos framework. To mitigate the inherent information bottleneck in SNNs, we design a Spiking ConvNeXt module to reduce Multiply-Accumulate (MAC) operations and incorporate an amplitude shortcut path to preserve crucial signal dynamics. Furthermore, to bridge the performance gap with its Artificial Neural Network (ANN) counterpart, we introduce a self-architectural distillation strategy to effectively transfer knowledge. A lightweight Temporal Shift Module is also integrated to enhance the model's ability to fuse information across the temporal dimension with negligible computational overhead. Experiments demonstrate that our model achieves performance comparable to its ANN counterpart, with UTMOS and PESQ scores of 3.74 and 3.45 respectively, while consuming only 14.7% of the energy. The source code is available at https://github.com/pymaster17/Spiking-Vocos.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

26 of 30 references.

References · 26

  1. 2022A ConvNet for the 2020scited by 3,545
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  3. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  4. 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  6. 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
  7. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  8. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
  9. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  10. 2018Efficient Neural Audio Synthesiscited by 218
  11. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
  12. 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 116
14 more
  1. 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
  2. 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
  3. 2021Chunked Autoregressive GAN for Conditional Waveform Synthesiscited by 38
  4. 2024SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanismscited by 31
  5. 2022iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transformcited by 30
  6. 2024Direct Training High-Performance Deep Spiking Neural Networks: A Review of Theories and Methodscited by 24
  7. 2023Spiking Denoising Diffusion Probabilistic Modelscited by 18
  8. 2024FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocodercited by 11
  9. 2024RFWave: Multi-band Rectified Flow for Audio Waveform Reconstructioncited by 9
  10. 2025WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matchingcited by 7
  11. 2025Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacementcited by 6
  12. 2025TS-SNN: Temporal Shift Module for Spiking Neural Networkscited by 5
  13. 2023APNet2: High-quality and High-efficiency Neural Vocoder with Direct Prediction of Amplitude and Phase Spectracited by 4
  14. 2024SpikeVoice: High-Quality Text-to-Speech Via Efficient Spiking Neural Networkcited by 3

Built on by

Not cited yet.