Analytic Continual Test-Time Adaptation for Multi-Modality Corruption
Not on the map. Why?
Abstract (arXiv)
Test-Time Adaptation (TTA) enables pre-trained models to bridge the gap between source and target datasets using unlabeled test data, addressing domain shifts caused by corruptions like weather changes, noise, or sensor malfunctions in test time. Multi-Modal Continual Test-Time Adaptation (MM-CTTA), as an extension of standard TTA, further allows models to handle multi-modal inputs and adapt to continuously evolving target domains. However, MM-CTTA faces critical challenges such as catastrophic forgetting and reliability bias, which are rarely addressed effectively under multi-modal corruption scenarios. In this paper, we propose a novel approach, Multi-modality Dynamic Analytic Adapter (MDAA), to tackle MM-CTTA tasks. MDAA introduces analytic learning,a closed-form training technique,through Analytic Classifiers (ACs) to mitigate catastrophic forgetting. Furthermore, we design the Dynamic Late Fusion Mechanism (DLFM) to dynamically select and integrate reliable information from different modalities. Extensive experiments show that MDAA achieves state-of-the-art performance across the proposed tasks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 29 Oct 2024.
Builds on
22 of 37 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2019When Does Label Smoothing Help?cited by 985
- 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 641
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 409
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
10 more
- 2018Progressive Feature Alignment for Unsupervised Domain Adaptationcited by 183
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
- 2022Contrastive Audio-Visual Masked Autoencodercited by 142
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
- 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 56
- 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptationcited by 48
- 2015Deep Transfer Network: Unsupervised Domain Adaptationcited by 20
- 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentationcited by 20
- 2024AIR: Analytic Imbalance Rectifier for Continual Learningcited by 7
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Audio-Visual Continual Test-Time Adaptation without Forgettingcited by 1
- 2026Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directionscited by 1
- 2026Decoupling Stability and Plasticity for Multi-Modal Test-Time Adaptationcited by 0
- 2026FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigationcited by 0
- 2026Not Every Correction Helps: Gain-Guided Continual Test-Time Adaptationcited by 0
- 2026Not Every Correction Helps: Gain-Guided Continual Test-Time Adaptation29 Sep 2026
- 2026Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions9 Jul 2026
- 2026FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation21 Jun 2026
- 2026Decoupling Stability and Plasticity for Multi-Modal Test-Time Adaptation28 Feb 2026
- 2026Audio-Visual Continual Test-Time Adaptation without Forgetting20 Feb 2026