mlsanityData to 7 Oct 2026

MixTTA: Low-Rank Cross-Channel Mixing for Reliable Test-Time Adaptation

arXiv 2606.28142 ↗First posted 26 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Test-Time Adaptation (TTA) methods commonly update the affine parameters of normalization layers to adapt deployed models under distribution shifts. However, per-channel affine parameters perform axis-aligned scaling and shifting, making them geometrically incapable of correcting cross-channel structural changes induced by distribution shift. To address this limitation, we propose MixTTA, a lightweight plug-in module that equips normalization layers with a low-rank cross-channel transformation, enabling inter-channel mixing at each layer. To ensure that the low-rank branch captures only cross-channel interactions, we also propose Decoupling Projection that enforces strict separation from the diagonal affine path, along with Spectral Projection that prevents rank-1 collapse under non-stationary test streams. MixTTA can be seamlessly integrated into any existing normalization-based TTA method. Experiments in both standard and wild TTA settings show consistent improvements over strong baselines while mitigating adaptation failure under challenging conditions. The source code is publicly available at https://github.com/delta6189/MixTTA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 26 Jun 2026.

Builds on

37 of 49 references.

References · 37

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2017Mask R-CNNcited by 7,259
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2016Layer Normalizationcited by 5,579
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
  9. 2022Visual Prompt Tuningcited by 1,674
  10. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  11. 2018Group Normalizationcited by 1,514
  12. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
25 more
  1. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  2. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
  3. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
  4. 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
  5. 2022Continual Test-Time Domain Adaptationcited by 520
  6. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  7. 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
  8. 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 409
  9. 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
  10. 2021Gradient Matching for Domain Generalizationcited by 258
  11. 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
  12. 2021Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptationcited by 176
  13. 2024Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factorscited by 106
  14. 2019HoMM: Higher-order Moment Matching for Unsupervised Domain Adaptationcited by 89
  15. 2017Minimal-Entropy Correlation Alignment for Unsupervised Deep Domain Adaptationcited by 70
  16. 2023ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptationcited by 58
  17. 2024COME: Test-time adaption by Conservatively Minimizing Entropycited by 31
  18. 2024BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptationcited by 25
  19. 2024Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Vision-Language Modelscited by 17
  20. 2025Beyond Entropy: Region Confidence Proxy for Wild Test-Time Adaptationcited by 11
  21. 2025LoRA-TTT: Low-Rank Test-Time Training for Vision-Language Modelscited by 7
  22. 2025Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generationcited by 5
  23. 2025Dimension Agnostic Neural Processescited by 5
  24. 2025MoETTA: Test-Time Adaptation Under Mixed Distribution Shifts with MoE-LayerNormcited by 4
  25. 2025Test-time Correlation Alignmentcited by 3

Built on by

Not cited yet.