Can You Hear, Localize, and Segment Continually? An Exemplar-Free Continual Learning Benchmark for Audio-Visual Segmentation
Not on the map. Why?
Abstract (arXiv)
Audio-Visual Segmentation (AVS) aims to produce pixel-level masks of sound producing objects in videos, by jointly learning from audio and visual signals. However, real-world environments are inherently dynamic, causing audio and visual distributions to evolve over time, which challenge existing AVS systems that assume static training settings. To address this gap, we introduce the first exemplar-free continual learning benchmark for Audio-Visual Segmentation, comprising four learning protocols across single-source and multi-source AVS datasets. We further propose a strong baseline, ATLAS, which uses audio-guided pre-fusion conditioning to modulate visual feature channels via projected audio context before cross-modal attention. Finally, we mitigate catastrophic forgetting by introducing Low-Rank Anchoring (LRA), which stabilizes adapted weights based on loss sensitivity. Extensive experiments demonstrate competitive performance across diverse continual scenarios, establishing a foundation for lifelong audio-visual perception. Code is available at*footnotePaper under review - hyperlinkhttps://gitlab.com/viper-purdue/atlashttps://gitlab.com/viper-purdue/atlas keywordsContinual Learning and Audio-Visual Segmentation and Multi-Modal Learning
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 42 of its 51 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
42 of 51 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Learning without Forgettingcited by 2,465
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2017Memory Aware Synapses: Learning what (not) to forgetcited by 1,094
- 2021Learning to Prompt for Continual Learningcited by 938
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 614
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2017Measuring Catastrophic Forgetting in Neural Networkscited by 359
30 more
- 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
- 2018Task-Free Continual Learningcited by 219
- 2023Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Needcited by 183
- 2020PLOP: Learning without Forgetting for Continual Semantic Segmentationcited by 177
- 2022Audio-Visual Segmentationcited by 148
- 2023FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learningcited by 86
- 2023Audio-Visual Segmentation with Semanticscited by 73
- 2021Online Continual Learning on Class Incremental Blurry Task Configuration with Anytime Inferencecited by 66
- 2023PILOT: A Pre-Trained Model-Based Continual Learning Toolboxcited by 64
- 2023AV-SAM: Segment Anything Model Meets Audio-Visual Localization and Segmentationcited by 52
- 2023Annotation-free Audio-Visual Segmentationcited by 44
- 2024Recent Advances of Multimodal Continual Learning: A Comprehensive Surveycited by 39
- 2024Gradient Reweighting: Towards Imbalanced Class-Incremental Learningcited by 37
- 2023Improving Audio-Visual Segmentation with Bidirectional Generationcited by 36
- 2023Unraveling Instance Associations: A Closer Look for Audio-Visual Segmentationcited by 33
- 2022CoMFormer: Continual Learning in Semantic and Panoptic Segmentationcited by 25
- 2023A Survey on Continual Semantic Segmentation: Theory, Challenge, Method and Applicationcited by 21
- 2023Weakly-Supervised Audio-Visual Segmentationcited by 19
- 2023Online Class-Incremental Learning For Real-World Food Image Classificationcited by 17
- 2025A Survey of Continual Reinforcement Learningcited by 16
- 2024Strike a Balance in Continual Panoptic Segmentationcited by 10
- 2024DELTA: Decoupling Long-Tailed Online Continual Learningcited by 8
- 2024Bootstrapping Audio-Visual Segmentation by Strengthening Audio Cuescited by 7
- 2025Beyond Background Shift: Rethinking Instance Replay in Continual Semantic Segmentationcited by 6
- 2025CSTA: Spatial-Temporal Causal Adaptive Learning for Exemplar-Free Video Class-Incremental Learningcited by 5
- 2025Do Audio-Visual Segmentation Models Truly Segment Sounding Objects?cited by 5
- 2025Revisiting Audio-Visual Segmentation with Vision-Centric Transformercited by 5
- 2025Taming Modality Entanglement in Continual Audio-Visual Segmentationcited by 3
- 2025Hierarchical Visual Prompt Learning for Continual Video Instance Segmentationcited by 2
- 2025PANDA -- Patch And Distribution-Aware Augmentation for Long-Tailed Exemplar-Free Continual Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.