MixTTA: Low-Rank Cross-Channel Mixing for Reliable Test-Time Adaptation
Not on the map. Why?
Abstract (arXiv)
Test-Time Adaptation (TTA) methods commonly update the affine parameters of normalization layers to adapt deployed models under distribution shifts. However, per-channel affine parameters perform axis-aligned scaling and shifting, making them geometrically incapable of correcting cross-channel structural changes induced by distribution shift. To address this limitation, we propose MixTTA, a lightweight plug-in module that equips normalization layers with a low-rank cross-channel transformation, enabling inter-channel mixing at each layer. To ensure that the low-rank branch captures only cross-channel interactions, we also propose Decoupling Projection that enforces strict separation from the diagonal affine path, along with Spectral Projection that prevents rank-1 collapse under non-stationary test streams. MixTTA can be seamlessly integrated into any existing normalization-based TTA method. Experiments in both standard and wild TTA settings show consistent improvements over strong baselines while mitigating adaptation failure under challenging conditions. The source code is publicly available at https://github.com/delta6189/MixTTA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
37 of 49 references.
References · 37
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2017Mask R-CNNcited by 7,259
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Layer Normalizationcited by 5,579
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2022Visual Prompt Tuningcited by 1,674
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
- 2018Group Normalizationcited by 1,514
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
25 more
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 409
- 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2021Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptationcited by 176
- 2024Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factorscited by 106
- 2019HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptationcited by 89
- 2017Minimal-Entropy Correlation Alignment for Unsupervised Deep Domain Adaptationcited by 70
- 2023ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptationcited by 58
- 2024COME: Test-time adaption by Conservatively Minimizing Entropycited by 31
- 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
- 2024Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Vision-Language Modelscited by 17
- 2025Beyond Entropy: Region Confidence Proxy for Wild Test-Time Adaptationcited by 11
- 2025LoRA-TTT: Low-Rank Test-Time Training for Vision-Language Modelscited by 7
- 2025Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generationcited by 5
- 2025Dimension Agnostic Neural Processescited by 5
- 2025MoETTA: Test-Time Adaptation Under Mixed Distribution Shifts with MoE-LayerNormcited by 4
- 2025Test-time Correlation Alignmentcited by 3
Built on by
Not cited yet.