mlsanityData to 14 Oct 2026

An Entropy-Guided Curriculum Learning Strategy for Data-Efficient Acoustic Scene Classification under Domain Shift

arXiv 2509.11168 ↗First posted 14 Sep 2025cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Acoustic Scene Classification (ASC) faces challenges in generalizing across recording devices, particularly when labeled data is limited. The DCASE 2024 Challenge Task 1 highlights this issue by requiring models to learn from small labeled subsets recorded on a few devices. These models need to then generalize to recordings from previously unseen devices under strict complexity constraints. While techniques such as data augmentation and the use of pre-trained models are well-established for improving model generalization, optimizing the training strategy represents a complementary yet less-explored path that introduces no additional architectural complexity or inference overhead. Among various training strategies, curriculum learning offers a promising paradigm by structuring the learning process from easier to harder examples. In this work, we propose an entropy-guided curriculum learning strategy to address the domain shift problem in data-efficient ASC. Specifically, we quantify the uncertainty of device domain predictions for each training sample by computing the Shannon entropy of the device posterior probabilities estimated by an auxiliary domain classifier. Using entropy as a proxy for domain invariance, the curriculum begins with high-entropy samples and gradually incorporates low-entropy, domain-specific ones to facilitate the learning of generalizable representations. Experimental results on multiple DCASE 2024 ASC baselines demonstrate that our strategy effectively mitigates domain shift, particularly under limited labeled data conditions. Our strategy is architecture-agnostic and introduces no additional inference cost, making it easily integrable into existing ASC baselines and offering a practical solution to domain shift.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 63 references that are in the map. First posted on arXiv 14 Sep 2025.

Builds on

36 of 63 references.

References · 36

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
  5. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  6. 2017Deep Image Priorcited by 1,098
  7. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  8. 2017MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labelscited by 653
  9. 2019Symmetric Cross Entropy for Robust Learning with Noisy Labelscited by 500
  10. 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 370
  11. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  12. 2019On The Power of Curriculum Learning in Training Deep Networkscited by 286
24 more
  1. 2022Self-Supervised Speech Representation Learning: A Reviewcited by 260
  2. 2022Comparative layer-wise analysis of self-supervised speech modelscited by 158
  3. 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 156
  4. 2017Curriculum Domain Adaptation for Semantic Segmentation of Urban Scenescited by 105
  5. 2022AVES: Animal Vocalization Encoder based on Self-Supervisioncited by 53
  6. 2020Acoustic scene classification in DCASE 2020 Challenge: generalization across devices and low complexity solutionscited by 50
  7. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 50
  8. 2022BEANS: The Benchmark of Animal Soundscited by 38
  9. 2024NatureLM-audio: an Audio-Language Foundation Model for Bioacousticscited by 33
  10. 2024ML-SUPERB 2.0: Benchmarking Multilingual Speech Models Across Modeling Constraints, Languages, and Datasetscited by 27
  11. 2014Acoustic Scene Classificationcited by 26
  12. 2020Probing Acoustic Representations for Phonetic Propertiescited by 26
  13. 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 21
  14. 2021HumBugDB: A Large-scale Acoustic Mosquito Datasetcited by 15
  15. 2024Uncertainty-guided Contrastive Learning for Single Source Domain Generalisationcited by 14
  16. 2023Device-Robust Acoustic Scene Classification via Impulse Response Augmentationcited by 11
  17. 2024Data-Efficient Low-Complexity Acoustic Scene Classification in the DCASE 2024 Challengecited by 9
  18. 2025Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processingcited by 9
  19. 2021IDMT-Traffic: An Open Benchmark Dataset for Acoustic Traffic Monitoring Researchcited by 8
  20. 2024Description on IEEE ICME 2024 Grand Challenge: Semi-supervised Acoustic Scene Classification under Domain Shiftcited by 7
  21. 2024Exploring bat song syllable representations in self-supervised audio encoderscited by 5
  22. 2023TF-SepNet: An Efficient 1D Kernel Design in CNNs for Low-Complexity Acoustic Scene Classificationcited by 4
  23. 2024On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysiscited by 4
  24. 2025MAIA: An Inpainting-Based Approach for Music Adversarial Attackscited by 2

Built on by

Not cited yet.