mlsanityData to 7 Oct 2026

Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation

arXiv 2603.08967 ↗First posted 9 Mar 2026cs.CV eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Audio-Visual Segmentation (AVS) aims to produce pixel-level masks of sound producing objects in videos, by jointly learning from audio and visual signals. However, real-world environments are inherently dynamic, causing audio and visual distributions to evolve over time, which challenge existing AVS systems that assume static training settings. To address this gap, we introduce the first exemplar-free continual learning benchmark for Audio-Visual Segmentation, comprising four learning protocols across single-source and multi-source AVS datasets. We further propose a strong baseline, ATLAS, which uses audio-guided pre-fusion conditioning to modulate visual feature channels via projected audio context before cross-modal attention. Finally, we mitigate catastrophic forgetting by introducing Low-Rank Anchoring (LRA), which stabilizes adapted weights based on loss sensitivity. Extensive experiments demonstrate competitive performance across diverse continual scenarios, establishing a foundation for lifelong audio-visual perception. Code is available at*footnotePaper under review - hyperlinkhttps://gitlab.com/viper-purdue/atlashttps://gitlab.com/viper-purdue/atlas keywordsContinual Learning and Audio-Visual Segmentation and Multi-Modal Learning

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

42 of 51 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  5. 2016Learning without Forgettingcited by 2,465
  6. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  7. 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
  8. 2021Learning to Prompt for Continual Learningcited by 938
  9. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  10. 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
  11. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  12. 2017Measuring Catastrophic Forgetting in Neural Networkscited by 359
30 more
  1. 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
  2. 2018Task-Free Continual Learningcited by 219
  3. 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
  4. 2020PLOP: Learning without Forgetting for Continual Semantic Segmentationcited by 177
  5. 2022Audio-Visual Segmentationcited by 148
  6. 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
  7. 2023Audio-Visual Segmentation with Semanticscited by 73
  8. 2021Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inferencecited by 66
  9. 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
  10. 2023AV-SAM: Segment Anything Model Meets Audio-Visual Localization and Segmentationcited by 52
  11. 2023Annotation-free Audio-Visual Segmentationcited by 44
  12. 2024Recent Advances of Multimodal Continual Learning: A Comprehensive Surveycited by 39
  13. 2024Gradient Reweighting: Towards Imbalanced Class-Incremental Learningcited by 37
  14. 2023Improving Audio-Visual Segmentation with Bidirectional Generationcited by 36
  15. 2023Unraveling Instance Associations: A Closer Look for Audio-Visual Segmentationcited by 33
  16. 2022CoMFormer: Continual Learning in Semantic and Panoptic Segmentationcited by 25
  17. 2023A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Applicationcited by 21
  18. 2023Weakly-Supervised Audio-Visual Segmentationcited by 19
  19. 2023Online Class-Incremental Learning For Real-World Food Image Classificationcited by 17
  20. 2025A Survey of Continual Reinforcement Learningcited by 16
  21. 2024Strike a Balance in Continual Panoptic Segmentationcited by 10
  22. 2024DELTA: Decoupling Long-Tailed Online Continual Learningcited by 8
  23. 2024Bootstrapping Audio-Visual Segmentation by Strengthening Audio Cuescited by 7
  24. 2025Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentationcited by 6
  25. 2025CSTA: Spatial-Temporal Causal Adaptive Learning for Exemplar-Free Video Class-Incremental Learningcited by 5
  26. 2025Do Audio-Visual Segmentation Models Truly Segment Sounding Objects?cited by 5
  27. 2025Revisiting Audio-Visual Segmentation with Vision-Centric Transformercited by 5
  28. 2025Taming Modality Entanglement in Continual Audio-Visual Segmentationcited by 3
  29. 2025Hierarchical Visual Prompt Learning for Continual Video Instance Segmentationcited by 2
  30. 2025PANDA -- Patch And Distribution-Aware Augmentation for Long-Tailed Exemplar-Free Continual Learningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.