Domain-incremental audio classification using domain-specific experts and prototype classifier
Not on the map. Why?
Abstract (arXiv)
This technical report presents submission systems for Task 7(domain-incremental audio classification) of the DCASE 2026 Challenge. The main obstacle is that, the system is unable to access to past or future domain's data at once. We approached domain-incremental learning (DIL) as a frozen-feature replay problem. At each incremental stage, one or two compact experts are trained and then kept fixed; at the final stage, the penultimate features from all frozen experts are concatenated and used to train a lightweight per-class prototype classifier solely on cached features. This design prevents catastrophic forgetting by preserving each expert models at inference. To retain earlier-domain knowledge without storing raw audio, some experts were trained with DeepInversion-based generative replay. A cross-stage regression imputer was trained to fill the expert feature slots that did not yet exist at an ealier stage. We submit four fully DIL-compliant systems: three systems based on diverse frozen five-expert backbones and their cross-stack ensemble achieving 78.15% micro / 77.03% macro on the development set, outperforming every individual backbone on both evaluations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 14 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
13 of 14 references.
References · 13
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2019Dreaming to Distill: Data-free Knowledge Transfer via DeepInversioncited by 423
- 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
- 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
- 2021PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregationcited by 82
- 2022Frequency Dynamic Convolution: Frequency-Adaptive Pattern Recognition for Sound Event Detectioncited by 23
- 2024Domain-Incremental Learning for Audio Classificationcited by 2
- 2026Domain-Agnostic Incremental Learning for Sound Classification. A DCASE 2026 Challenge taskcited by 2
Built on by
Not cited yet.