mlsanityData to 14 Oct 2026

A Benchmark of Generative Methods for Zero-Shot Environmental Sound Classification

arXiv 2412.03771 ↗First posted 4 Dec 2024cs.SD cs.LG eess.AScited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Zero-shot learning enables models to generalise to unseen classes using semantic information, bridging the gap between training classes and previously unseen test classes. While widely studied in computer vision, its application to environmental audio remains underexplored, and generative approaches have received little attention. This work presents the first benchmark of generative methods for zero-shot environmental sound classification. Four approaches spanning variational, adversarial, diffusion-based, and denoising paradigms are evaluated. The benchmark includes CADA-VAE and LisGAN, adapted from computer vision, together with two embedding-generation methods introduced in this work: one based on a denoising diffusion probabilistic model (DDPM) and the other on a conditional generative denoising network (CGDN). Experiments on five environmental audio datasets (ESC-50, ARCA23K-FSD, FSC22, UrbanSound8K, and TAU Urban Acoustic Scenes 2019) and one music dataset (GTZAN) show that generative methods are competitive with established compatibility-based approaches. Among the evaluated generative methods, CGDN achieves the highest average accuracy and is the only one to significantly outperform both the DDPM- and GAN-based methods, while remaining statistically indistinguishable from the strong ALE baseline. These findings suggest that optimisation stability is an important factor in generative zero-shot learning for environmental audio.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 26 of its 52 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

26 of 52 references.

References · 26

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  5. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
  6. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  7. 2017Zero-Shot Learning -- The Good, the Bad and the Uglycited by 255
  8. 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
  9. 2015Label-Embedding for Image Classificationcited by 165
  10. 2023Text-to-Image Diffusion Models are Zero-Shot Classifierscited by 143
  11. 2017A Generative Adversarial Approach for Zero-Shot Learning from Noisy Textscited by 96
  12. 2019Leveraging the Invariant Side of Generative Zero-Shot Learningcited by 83
14 more
  1. 2018A multi-device dataset for urban acoustic scene classificationcited by 75
  2. 2017A Generative Model For Zero Shot Learning Using Conditional Variational Autoencoderscited by 64
  3. 2018Generative Dual Adversarial Network for Generalized Zero-shot Learningcited by 61
  4. 2021A Closer Look at Self-training for Zero-Label Semantic Segmentationcited by 57
  5. 2017Learning Robust Visual-Semantic Embeddingscited by 56
  6. 2021Zero-Shot Instance Segmentationcited by 40
  7. 2020Zero-Shot Audio Classification via Semantic Embeddingscited by 21
  8. 2021Task Aligned Generative Meta-learning for Zero-shot Learningcited by 19
  9. 2024ZeroDiff: Solidified Visual-Semantic Correlation in Zero-Shot Learningcited by 10
  10. 2019Zero-Shot Audio Classification Based on Class Label Embeddingscited by 9
  11. 2020Zero-Shot Audio Classification with Factored Linear and Nonlinear Acoustic-Semantic Projectionscited by 6
  12. 2023C-SAW: Self-Supervised Prompt Learning for Image Generalization in Remote Sensingcited by 6
  13. 2017Deep Matching Autoencoderscited by 3
  14. 2021ARCA23K: An audio dataset for investigating open-set label noisecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Data Augmentation for Environmental Sound Classification Using Diffusion Probabilistic Model with Top-k Selection Discriminator
  2. 2025ZeroSep: Separate Anything in Audio with Zero Training
  3. 2024Urban Sound Propagation: a Benchmark for 1-Step Generative Modeling of Complex Physical Systems
  4. 2025High-Quality Sound Separation Across Diverse Categories via Visually-Guided Generative Modeling
  5. 2026SCAPES: Semantically Conditioned Autoregressive Prior for Environmental Sounds
  6. 2024Diffusion Models for Audio Restoration
  7. 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments
  8. 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration