Neural Synthesis of Footsteps Sound Effects with Generative Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Footsteps are among the most ubiquitous sound effects in multimedia applications. There is substantial research into understanding the acoustic features and developing synthesis models for footstep sound effects. In this paper, we present a first attempt at adopting neural synthesis for this task. We implemented two GAN-based architectures and compared the results with real recordings as well as six traditional sound synthesis methods. Our architectures reached realism scores as high as recorded samples, showing encouraging results for the task at hand.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 15 of its 44 references that are in the map. First posted on arXiv 18 Oct 2021.
Builds on
15 of 44 references.
References · 15
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
- 2018Adversarial Audio Synthesiscited by 222
- 2020DrumGAN: Synthesis of Drum Sounds With Timbral Feature Conditioning Using Generative Adversarial Networkscited by 34
- 2020VocGAN: A High-Fidelity Real-time Vocoder with a Hierarchically-nested Adversarial Networkcited by 26
- 2021GAN Vocoder: Multi-Resolution Discriminator Is All You Needcited by 16
- 2021One Billion Audio Sounds from GPU-enabled Modular Synthesiscited by 11
- 2020Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domainscited by 9
- 2019Neural Drum Machine : An Interactive System for Real-time Synthesis of Drum Soundscited by 8
3 more
- 2019Neural Percussive Synthesis Parameterised by High-Level Timbral Featurescited by 8
- 2018Conditional WaveGANcited by 7
- 2021Improved parallel WaveGAN vocoder with perceptually weighted spectrogram losscited by 6
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 2.
4 papers.
- 2022Full-band General Audio Synthesis with Score-based Diffusioncited by 32
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesiscited by 17
- 2024FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignmentcited by 5
- 2023A General Framework for Learning Procedural Audio Models of Environmental Soundscited by 0
- 2024FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignment19 Dec 2024
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis17 Jan 2024
- 2023A General Framework for Learning Procedural Audio Models of Environmental Sounds4 Mar 2023
- 2022Full-band General Audio Synthesis with Score-based Diffusion26 Oct 2022