Foley Sound Synthesis at the DCASE 2023 Challenge
Not on the map. Why?
Abstract (arXiv)
The addition of Foley sound effects during post-production is a common technique used to enhance the perceived acoustic properties of multimedia content. Traditionally, Foley sound has been produced by human Foley artists, which involves manual recording and mixing of sound. However, recent advances in sound synthesis and generative models have generated interest in machine-assisted or automatic Foley synthesis techniques. To promote further research in this area, we have organized a challenge in DCASE 2023: Task 7 - Foley Sound Synthesis. Our challenge aims to provide a standardized evaluation framework that is both rigorous and efficient, allowing for the evaluation of different Foley synthesis systems. We received 17 submissions, and performed both objective and subjective evaluation to rank them according to three criteria: audio quality, fit-to-category, and diversity. Through this challenge, we hope to encourage active participation from the research community and advance the state-of-the-art in automatic Foley synthesis. In this technical report, we provide a detailed overview of the Foley sound synthesis challenge, including task definition, dataset, baseline, evaluation scheme and criteria, challenge result, and discussion.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 8; 2024: 6; 2025: 4; 2026: 1.
19 papers.
Sort:
By area:
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
- 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
- 2025UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generationcited by 21
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesiscited by 17
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesiscited by 15
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detectioncited by 11
- 2023Text-Driven Foley Sound Generation With Latent Diffusion Modelcited by 10
- 2023Generation or Replication: Auscultating Audio Latent Diffusion Modelscited by 9
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generationcited by 9
- 2024Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generationcited by 6
- 2023Latent Diffusion Model Based Foley Sound Generation System For DCASE Challenge 2023 Task 7cited by 4
7 more
- 2023A Demand-Driven Perspective on Generative Audio AIcited by 4
- 2024MambaFoley: Foley Sound Generation using Selective State-Space Modelscited by 3
- 2023VIFS: An End-to-End Variational Inference for Foley Sound Synthesiscited by 2
- 2023FALL-E: A Foley Sound Synthesis Model and Strategiescited by 2
- 2024Latent CLAP Loss for Better Foley Sound Synthesiscited by 1
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesiscited by 1
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generationcited by 0
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generation31 Jul 2026
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis14 Oct 2025
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detection25 May 2025
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generation21 Feb 2025
- 2025UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generation6 Feb 2025
- 2024Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generation23 Oct 2024
- 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models13 Oct 2024
- 2024MambaFoley: Foley Sound Generation using Selective State-Space Models13 Sep 2024
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation28 May 2024
- 2024Latent CLAP Loss for Better Foley Sound Synthesis18 Mar 2024
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis17 Jan 2024
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis15 Nov 2023
7 more
- 2023Generation or Replication: Auscultating Audio Latent Diffusion Models16 Oct 2023
- 2023WavJourney: Compositional Audio Creation with Large Language Models26 Jul 2023
- 2023A Demand-Driven Perspective on Generative Audio AI10 Jul 2023
- 2023Text-Driven Foley Sound Generation With Latent Diffusion Model17 Jun 2023
- 2023FALL-E: A Foley Sound Synthesis Model and Strategies16 Jun 2023
- 2023VIFS: An End-to-End Variational Inference for Foley Sound Synthesis8 Jun 2023
- 2023Latent Diffusion Model Based Foley Sound Generation System For DCASE Challenge 2023 Task 725 May 2023
- 2025UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generationcited by 21
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesiscited by 17
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesiscited by 15
- 2023Text-Driven Foley Sound Generation With Latent Diffusion Modelcited by 10
- 2023Generation or Replication: Auscultating Audio Latent Diffusion Modelscited by 9
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generationcited by 9
- 2023Latent Diffusion Model Based Foley Sound Generation System For DCASE Challenge 2023 Task 7cited by 4
- 2024MambaFoley: Foley Sound Generation using Selective State-Space Modelscited by 3
- 2024Latent CLAP Loss for Better Foley Sound Synthesiscited by 1
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesiscited by 1
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generationcited by 0
- 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generation31 Jul 2026
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis14 Oct 2025
- 2025UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generation6 Feb 2025
- 2024MambaFoley: Foley Sound Generation using Selective State-Space Models13 Sep 2024
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation28 May 2024
- 2024Latent CLAP Loss for Better Foley Sound Synthesis18 Mar 2024
- 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesis17 Jan 2024
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis15 Nov 2023
- 2023Generation or Replication: Auscultating Audio Latent Diffusion Models16 Oct 2023
- 2023Text-Driven Foley Sound Generation With Latent Diffusion Model17 Jun 2023
- 2023Latent Diffusion Model Based Foley Sound Generation System For DCASE Challenge 2023 Task 725 May 2023
- 2023WavJourney: Compositional Audio Creation with Large Language Modelscited by 27
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generationcited by 24
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detectioncited by 11
- 2024Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generationcited by 6
- 2023A Demand-Driven Perspective on Generative Audio AIcited by 4
- 2023VIFS: An End-to-End Variational Inference for Foley Sound Synthesiscited by 2
- 2023FALL-E: A Foley Sound Synthesis Model and Strategiescited by 2
- 2025EnvSDD: Benchmarking Environmental Sound Deepfake Detection25 May 2025
- 2025KAD: No More FAD! An Effective and Efficient Evaluation Metric for Audio Generation21 Feb 2025
- 2024Challenge on Sound Scene Synthesis: Evaluating Text-to-Audio Generation23 Oct 2024
- 2023WavJourney: Compositional Audio Creation with Large Language Models26 Jul 2023
- 2023A Demand-Driven Perspective on Generative Audio AI10 Jul 2023
- 2023FALL-E: A Foley Sound Synthesis Model and Strategies16 Jun 2023
- 2023VIFS: An End-to-End Variational Inference for Foley Sound Synthesis8 Jun 2023