Robust Test-Time Adaptation in Dynamic Scenarios
Not on the map. Why?
Abstract (arXiv)
Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently sampled data from single or multiple distributions. However, these attempts may fail in dynamic scenarios of real-world applications like autonomous driving, where the environments gradually change and the test data is sampled correlatively over time. In this work, we explore such practical test data streams to deploy the model on the fly, namely practical test-time adaptation (PTTA). To do so, we elaborate a Robust Test-Time Adaptation (RoTTA) method against the complex data stream in PTTA. More specifically, we present a robust batch normalization scheme to estimate the normalization statistics. Meanwhile, a memory bank is utilized to sample category-balanced data with consideration of timeliness and uncertainty. Further, to stabilize the training procedure, we develop a time-aware reweighting strategy with a teacher-student model. Extensive experiments prove that RoTTA enables continual testtime adaptation on the correlatively sampled data streams. Our method is easy to implement, making it a good choice for rapid deployment. The code is publicly available at https://github.com/BIT-DA/RoTTA
Key facts. Cited by 185 papers in the map (data through 7 Oct 2026). Builds on 59 of its 85 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
59 of 85 references.
References · 59
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2016Wide Residual Networkscited by 3,057
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2016Learning without Forgettingcited by 2,465
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,313
38 more
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
- 2017Adversarial Discriminative Domain Adaptationcited by 1,309
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021Domain Generalization: A Surveycited by 760
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2018End-to-End Incremental Learningcited by 596
- 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
- 2019Gradient based sample selection for online continual learningcited by 568
- 2021Domain Generalization with MixStylecited by 563
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
- 2022Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Modelscited by 379
- 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
- 2022Contrastive Test-Time Adaptationcited by 258
- 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
- 2020Domain Generalization using Causal Matchingcited by 224
- 2020Universal Source-Free Domain Adaptationcited by 219
- 2022Test-Time Training with Masked Autoencoderscited by 208
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
- 2022Parameter-free Online Test-time Adaptationcited by 184
- 2021Generalized Source-free Domain Adaptationcited by 175
- 2021Source-Free Domain Adaptation for Semantic Segmentationcited by 168
- 2020Understanding Self-Training for Gradual Domain Adaptationcited by 149
- 2020Robust and Generalizable Visual Representation Learning via Random Convolutionscited by 141
- 2020Learning to Learn with Variational Information Bottleneck for Domain Generalizationcited by 102
- 2022Test-Time Adaptation via Conjugate Pseudo-labelscited by 98
- 2022Visual Prompt Tuning for Test-time Domain Adaptationcited by 97
- 2021GCR: Gradient Coreset Based Replay Buffer Selection For Continual Learningcited by 95
- 2021Domain Impression: A Source Data Free Domain Adaptation Methodcited by 91
- 2022SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentationcited by 87
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022Improving Test-Time Adaptation via Shift-agnostic Weight Regularization and Nearest Source Prototypescited by 67
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2023: 18; 2024: 49; 2025: 64; 2026: 54.
185 papers.
Sort:
By area:
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2023Universal Test-time Adaptation through Weight Ensembling, Diversity Weighting, and Prior Correctioncited by 65
- 2023SoTTA: Robust Test-Time Adaptation on Noisy Data Streamscited by 63
- 2023ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptationcited by 58
- 2023In Search of Lost Online Test-time Adaptation: A Surveycited by 43
- 2023Test-Time Training on Video Streamscited by 37
- 2024Frustratingly Easy Test-Time Adaptation of Vision-Language Modelscited by 36
- 2023Towards Real-World Test-Time Adaptation: Tri-Net Self-Training with Balanced Normalizationcited by 34
- 2024DPCore: Dynamic Prompt Coreset for Continual Test-Time Adaptationcited by 33
- 2023Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptationcited by 30
- 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
38 more
- 2024The Entropy Enigma: Success and Failure of Entropy Minimizationcited by 24
- 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Modelscited by 23
- 2024Protected Test-Time Adaptation via Online Entropy Matching: A Betting Approachcited by 22
- 2024DOTA: Distributional Test-Time Adaptation of Vision-Language Modelscited by 22
- 2024Historical Test-time Prompt Tuning for Vision Foundation Modelscited by 21
- 2025Test3R: Learning to Reconstruct 3D at Test Timecited by 19
- 2023Persistent Test-time Adaptation in Recurring Testing Scenarioscited by 18
- 2024Unified Entropy Optimization for Open-Set Test-Time Adaptationcited by 17
- 2025Test-Time Training Provably Improves Transformers as In-context Learnerscited by 15
- 2025Realistic Test-Time Adaptation of Vision-Language Modelscited by 14
- 2025MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Mergingcited by 14
- 2025Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptationcited by 14
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 13
- 2024Distribution Alignment for Fully Test-Time Adaptation with Dynamic Online Data Streamscited by 13
- 2024STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replaycited by 13
- 2023Calibration-free online test-time adaptation for electroencephalography motor imagery decodingcited by 12
- 2024textttBATCLIP: Bimodal Online Test-Time Adaptation for CLIPcited by 11
- 2025Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimizationcited by 11
- 2023Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentationcited by 10
- 2023Unraveling Batch Normalization for Realistic Test-Time Adaptationcited by 10
- 2024MedBN: Robust Test-Time Adaptation against Malicious Test Samplescited by 10
- 2024A Lost Opportunity for Vision-Language Models: A Comparative Study of Online Test-Time Adaptation for Vision-Language Modelscited by 10
- 2025Monitoring Risks in Test-Time Adaptationcited by 10
- 2024AETTA: Label-Free Accuracy Estimation for Test-Time Adaptationcited by 9
- 2024Reshaping the Online Data Buffering and Organizing Mechanism for Continual Test-Time Adaptationcited by 9
- 2025Smoothing the Shift: Towards Stable Test-Time Adaptation under Complex Multimodal Noisescited by 9
- 2025ReservoirTTA: Prolonged Test-time Adaptation for Evolving and Recurring Domainscited by 8
- 2024Un-Mixing Test-Time Normalization Statistics: Combatting Label Temporal Correlationcited by 7
- 2024Decoupled Prototype Learning for Reliable Test-Time Adaptationcited by 7
- 2024Variational Continual Test-Time Adaptationcited by 7
- 2024A Layer Selection Approach to Test Time Adaptationcited by 7
- 2024Learning Visual Conditioning Tokens to Correct Domain Shift for Fully Test-time Adaptationcited by 7
- 2025CoPEFT: Fast Adaptation Framework for Multi-Agent Collaborative Perception with Parameter-Efficient Fine-Tuningcited by 7
- 2025SURGEON: Memory-Adaptive Fully Test-Time Adaptation via Dynamic Activation Sparsitycited by 7
- 2024Controllable Continual Test-Time Adaptationcited by 6
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detectioncited by 6
- 2024Temporal Test-Time Adaptation with State-Space Modelscited by 6
- 2024UniTTA: Unified Benchmark and Versatile Framework Towards Realistic Test-Time Adaptationcited by 6
50 most cited of 185 All 185 (JSON)
- 2026WISE-ATTA: When to Ask for Labels in Budgeted Active Test-Time Adaptation29 Sep 2026
- 2026Not Every Correction Helps: Gain-Guided Continual Test-Time Adaptation29 Sep 2026
- 2026Position Aware Layer Queries for Test Time Training in Vision Language Models27 Sep 2026
- 2026SPeaR: Test-Time Adaptation with Steering Primitives for Realigning Representations21 Sep 2026
- 2026Sampling headroom is not selection gain: a compute-value audit of test-time scaling for video world models6 Sep 2026
- 2026Rethinking the Teacher-Student Framework for Test-Time Adaptation2 Sep 2026
- 2026DESA-TTA: Dynamic EMA and Source Anchoring for Test-Time Adaptation1 Sep 2026
- 2026Continual Test-Time Adaptation via Entropy Sensitivity-Guidance in Strict Online Setting30 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model18 Aug 2026
- 2026Curvature-Aware Zeroth-Order Optimization for Memory-Efficient Test-Time Adaptation12 Aug 2026
- 2026Explanation Stability of Test-Time Adaptation in Computational Pathology: A Large-Scale Benchmark7 Aug 2026
38 more
- 2026Suppress and Diversify: Refining Robust Pathways for Corruption Robustness7 Aug 2026
- 2026Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition6 Aug 2026
- 2026Optimal Training-Time Scaling in Gradual Adaptation5 Aug 2026
- 2026An active-learning framework for real-time depth perception from monocular vision streams5 Aug 2026
- 2026Robustness Emerges Early in Training Dynamics, but Is Not Preserved5 Aug 2026
- 2026UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution4 Aug 2026
- 2026Logit-Origin Centering for Singleton Test-Time Adaptation2 Aug 2026
- 2026Test-Time Curriculum for Open-Set AIGC Detection1 Aug 2026
- 2026Source-Free Controlled Adaptation of Teachers for Continual Test-Time Adaptation26 Jul 2026
- 2026Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions9 Jul 2026
- 2026Leveraging Pathology Co-occurrence for Test-Time Adaptation in Chest X-Ray Diagnosis4 Jul 2026
- 2026Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging3 Jul 2026
- 2026BP-TTA: Balanced and Prototype-Guided Test-Time Adaptation in Dynamic Scenarios30 Jun 2026
- 2026ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Models27 Jun 2026
- 2026Forget, Anticipate and Adapt: Test Time Training for Long Videos25 Jun 2026
- 2026Reliability-Guided Adaptive Ensembling for Robust Test-Time Adaptation21 Jun 2026
- 2026Distill Once, Adapt Life-Long: Exploring Dataset Distillation for Continual Test-Time Adaptation18 Jun 2026
- 2026A Decision-Theoretic View of Test-Time Training: When, How Far, and Which Directions to Adapt14 Jun 2026
- 2026What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspective12 Jun 2026
- 2026DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation2 Jun 2026
- 2026On the Learnability of Test-Time Adaptation: A Recovery Complexity Perspective27 May 2026
- 2026MMD-Balls as Credal Sets: A PAC-Bayesian Framework for Epistemic Uncertainty in Test-Time Adaptation20 May 2026
- 2026GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation19 May 2026
- 2026Dance Across Shifts: Forward-Facilitation Continual Test-Time Adaptation through Dynamic Style Bridging18 May 2026
- 2026Reliability-Gated Source Anchoring for Continual Test-Time Adaptation13 May 2026
- 2026STEPS: A Temporal Smooth Error Propagation Solver on the Manifolds for Test-Time Adaptation in Time Series Forecasting8 May 2026
- 2026Temporal Structure Matters for Efficient Test-Time Adaptation in Wearable Human Activity Recognition6 May 2026
- 2026Ramen: Robust Test-Time Adaptation of Vision-Language Models with Active Sample Selection23 Apr 2026
- 2026Mitigating the ID-OOD Tradeoff in Open-Set Test-Time Adaptation2 Apr 2026
- 2026CD-Buffer: Complementary Dual-Buffer Framework for Test-Time Adaptation in Adverse Weather Object Detection27 Mar 2026
- 2026Test-Time Adaptation via Cache Personalization for Facial Expression Recognition in Videos22 Mar 2026
- 2026One Pool Is Not Enough: Multi-Cluster Memory for Practical Test-Time Adaptation22 Mar 2026
- 2026Evaluating Test-Time Adaptation For Facial Expression Recognition Under Natural Cross-Dataset Distribution Shifts20 Mar 2026
- 2026TALON: Test-time Adaptive Learning for On-the-Fly Category Discovery9 Mar 2026
- 2026When and Where to Reset Matters for Long-Term Test-Time Adaptation4 Mar 2026
- 2026Decoupling Stability and Plasticity for Multi-Modal Test-Time Adaptation28 Feb 2026
- 2026Learning from Yesterday's Error: An Efficient Online Learning Method for Traffic Demand Prediction25 Feb 2026
- 2026Tempora: Characterising the Time-Contingent Utility of Online Test-Time Adaptation5 Feb 2026
50 newest of 185 All 185 (JSON)
- 2024Frustratingly Easy Test-Time Adaptation of Vision-Language Modelscited by 36
- 2024DOTA: Distributional Test-Time Adaptation of Vision-Language Modelscited by 22
- 2025Realistic Test-Time Adaptation of Vision-Language Modelscited by 14
- 2024A Lost Opportunity for Vision-Language Models: A Comparative Study of Online Test-Time Adaptation for Vision-Language Modelscited by 10
- 2025CLIPTTA: Robust Contrastive Vision-Language Test-Time Adaptationcited by 5
- 2024Semantic Anchor Transport: Robust Test-Time Adaptation for Vision-Language Modelscited by 3
- 2026What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspectivecited by 2
- 2025Space Rotation with Basis Transformation for Training-free Test-Time Adaptationcited by 1
- 2025Uniformity First: Uniformity-aware Test-time Adaptation of Vision-language Models against Image Corruptioncited by 1
- 2025Unleashing the Potential of All Test Samples: Mean-Shift Guided Test-Time Adaptationcited by 1
- 2026ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Modelscited by 1
- 2026Fair Context Learning for Evidence-Balanced Test-Time Adaptation in Vision-Language Modelscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Position Aware Layer Queries for Test Time Training in Vision Language Models27 Sep 2026
- 2026From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model18 Aug 2026
- 2026UniEvo-RS: Omni-Prompt Unified Remote Sensing Segmentation with Representative Exemplar-Driven Prototype Evolution4 Aug 2026
- 2026ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Models27 Jun 2026
- 2026What Drives Test-Time Adaptation for CLIP? A Controlled Empirical Study from an Update Perspective12 Jun 2026
- 2026Ramen: Robust Test-Time Adaptation of Vision-Language Models with Active Sample Selection23 Apr 2026
- 2026Fair Context Learning for Evidence-Balanced Test-Time Adaptation in Vision-Language Models2 Feb 2026
- 2025CLIPTTA: Robust Contrastive Vision-Language Test-Time Adaptation18 Jul 2025
- 2025Unleashing the Potential of All Test Samples: Mean-Shift Guided Test-Time Adaptation1 Jul 2025
- 2025Uniformity First: Uniformity-aware Test-time Adaptation of Vision-language Models against Image Corruption19 May 2025
- 2025Space Rotation with Basis Transformation for Training-free Test-Time Adaptation27 Feb 2025
- 2025Realistic Test-Time Adaptation of Vision-Language Models7 Jan 2025
12 newest of 16 All 16 (JSON)
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2025DriveSuprim: Towards Precise Trajectory Selection for End-to-End Planningcited by 91
- 2023Universal Test-time Adaptation through Weight Ensembling, Diversity Weighting, and Prior Correctioncited by 65
- 2023SoTTA: Robust Test-Time Adaptation on Noisy Data Streamscited by 63
- 2023ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptationcited by 58
- 2023In Search of Lost Online Test-time Adaptation: A Surveycited by 43
- 2023Test-Time Training on Video Streamscited by 37
- 2023Towards Real-World Test-Time Adaptation: Tri-Net Self-Training with Balanced Normalizationcited by 34
- 2024DPCore: Dynamic Prompt Coreset for Continual Test-Time Adaptationcited by 33
- 2023Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptationcited by 30
- 2023Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigationcited by 25
- 2024The Entropy Enigma: Success and Failure of Entropy Minimizationcited by 24
12 most cited of 163 All 163 (JSON)
- 2026WISE-ATTA: When to Ask for Labels in Budgeted Active Test-Time Adaptation29 Sep 2026
- 2026Not Every Correction Helps: Gain-Guided Continual Test-Time Adaptation29 Sep 2026
- 2026SPeaR: Test-Time Adaptation with Steering Primitives for Realigning Representations21 Sep 2026
- 2026Rethinking the Teacher-Student Framework for Test-Time Adaptation2 Sep 2026
- 2026DESA-TTA: Dynamic EMA and Source Anchoring for Test-Time Adaptation1 Sep 2026
- 2026Continual Test-Time Adaptation via Entropy Sensitivity-Guidance in Strict Online Setting30 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Curvature-Aware Zeroth-Order Optimization for Memory-Efficient Test-Time Adaptation12 Aug 2026
- 2026Explanation Stability of Test-Time Adaptation in Computational Pathology: A Large-Scale Benchmark7 Aug 2026
- 2026Suppress and Diversify: Refining Robust Pathways for Corruption Robustness7 Aug 2026
- 2026Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition6 Aug 2026
- 2026Optimal Training-Time Scaling in Gradual Adaptation5 Aug 2026
12 newest of 163 All 163 (JSON)