mlsanityData to 7 Oct 2026

Analytic Continual Test-Time Adaptation for Multi-Modality Corruption

arXiv 2410.22373 ↗First posted 29 Oct 2024cs.LG cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Test-Time Adaptation (TTA) enables pre-trained models to bridge the gap between source and target datasets using unlabeled test data, addressing domain shifts caused by corruptions like weather changes, noise, or sensor malfunctions in test time. Multi-Modal Continual Test-Time Adaptation (MM-CTTA), as an extension of standard TTA, further allows models to handle multi-modal inputs and adapt to continuously evolving target domains. However, MM-CTTA faces critical challenges such as catastrophic forgetting and reliability bias, which are rarely addressed effectively under multi-modal corruption scenarios. In this paper, we propose a novel approach, Multi-modality Dynamic Analytic Adapter (MDAA), to tackle MM-CTTA tasks. MDAA introduces analytic learning,a closed-form training technique,through Analytic Classifiers (ACs) to mitigate catastrophic forgetting. Furthermore, we design the Dynamic Late Fusion Mechanism (DLFM) to dynamically select and integrate reliable information from different modalities. Extensive experiments show that MDAA achieves state-of-the-art performance across the proposed tasks.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 22 of its 37 references that are in the map. First posted on arXiv 29 Oct 2024.

Builds on

22 of 37 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  5. 2017The Kinetics Human Action Video Datasetcited by 1,894
  6. 2019When Does Label Smoothing Help?cited by 985
  7. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 641
  8. 2022Continual Test-Time Domain Adaptationcited by 520
  9. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  10. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 409
  11. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
  12. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 340
10 more
  1. 2018Progressive Feature Alignment for Unsupervised Domain Adaptationcited by 183
  2. 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
  3. 2022Contrastive Audio-Visual Masked Autoencodercited by 142
  4. 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
  5. 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
  6. 2022ACIL: Analytic Class-Incremental Learning with Absolute Memorization and Privacy Protectioncited by 56
  7. 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptationcited by 48
  8. 2015Deep Transfer Network: Unsupervised Domain Adaptationcited by 20
  9. 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentationcited by 20
  10. 2024AIR: Analytic Imbalance Rectifier for Continual Learningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.