mlsanityData to 7 Oct 2026

Parameter isolation with domain-specific experts for incremental audio classification

arXiv 2609.14730 ↗First posted 13 Sep 2026eess.AS cs.LG cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

To successfully deploy a model in time-varying environments such as streaming data prediction and sensing control, domain-incremental learning (DIL) has attracted attention since it aims to adapt a previously trained model to newly arriving domains, while reserving knowledge from earlier domains without accessing their data. Incremental learning across domains can be regarded as a recurrent update, in which the current model is obtained by updating the model carried over from previous domains. Conventional DIL approaches that rely on domain-invariant feature learning and weight regularization gradually overwrite or constrain parameters learned in previous domains, leading to catastrophic forgetting. Instead, this paper proposes a new domain-specific parameter-isolation architecture that retains all past domains. The proposed architecture mitigates catastrophic forgetting through a full-order recurrent update, constructing a new expert using domain-specific data conditioned on all previously frozen models. To achieve this, we incorporate data-free generative replay to reconstruct previous-domain data and cross-domain feature generation to recover later expert features missing from earlier domain samples. Finally, we apply the proposed model architecture to domain-agnostic incremental learning for audio classification, as defined in the DCASE 2026 Challenge Task 7. Consequently, we achieve micro and macro accuracies of 78.4% and 78.9%, respectively, representing increases of 33 and 25 percentage points over the Challenge baseline. Ablation studies are conducted to examine the effectiveness of each processing component in terms of classification accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 13 Sep 2026.

Builds on

20 of 24 references.

References · 20

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  4. 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
  5. 2016Progressive Neural Networkscited by 1,332
  6. 2017Continual Learning with Deep Generative Replaycited by 1,152
  7. 2018Experience Replay for Continual Learningcited by 1,074
  8. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  9. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 860
  10. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  11. 2018Progress & Compress: A scalable framework for continual learningcited by 516
  12. 2019Dreaming to Distill: Data-free Knowledge Transfer via DeepInversioncited by 419
8 more
  1. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 369
  2. 2021DER: Dynamically Expandable Representation for Class Incremental Learningcited by 355
  3. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  4. 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 243
  5. 2017NormFace: L2 Hypersphere Embedding for Face Verificationcited by 237
  6. 2021PSLA: Improving Audio Tagging with Pretraining, Sampling, Labeling, and Aggregationcited by 81
  7. 2024Domain-Incremental Learning for Audio Classificationcited by 2
  8. 2026Domain-Agnostic Incremental Learning for Sound Classification. A DCASE 2026 Challenge taskcited by 2

Built on by

Not cited yet.