Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clustering
Not on the map. Why?
Abstract (arXiv)
Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available and instant inference on target domain is required. Despite many efforts into TTT, there is a confusion over the experimental settings, thus leading to unfair comparisons. In this work, we first revisit TTT assumptions and categorize TTT protocols by two key factors. Among the multiple protocols, we adopt a realistic sequential test-time training (sTTT) protocol, under which we further develop a test-time anchored clustering (TTAC) approach to enable stronger test-time feature learning. TTAC discovers clusters in both source and target domain and match the target clusters to the source ones to improve generalization. Pseudo label filtering and iterative updating are developed to improve the effectiveness and efficiency of anchored clustering. We demonstrate that under all TTT protocols TTAC consistently outperforms the state-of-the-art methods on six TTT datasets. We hope this work will provide a fair benchmarking of TTT methods and future research should be compared within respective protocols. A demo code is available at https://github.com/Gorilla-Lab-SCUT/TTAC.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 28 of its 45 references that are in the map. First posted on arXiv 6 Jun 2022.
Builds on
28 of 45 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,053
16 more
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
- 2021Domain Generalization: A Surveycited by 760
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 507
- 2017VisDA: The Visual Domain Adaptation Challengecited by 432
- 2020Universal Source-Free Domain Adaptationcited by 219
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2021Generalized Source-free Domain Adaptationcited by 175
- 2018Learning to Learn from Noisy Labeled Datacited by 160
- 2017Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptationcited by 151
- 2020Unsupervised Domain Adaptation via Structurally Regularized Deep Clusteringcited by 140
- 2022Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptionscited by 78
- 2021Source-Free Adaptation to Measurement Shift via Bottom-Up Feature Restorationcited by 50
- 2017Robust Unsupervised Domain Adaptation for Neural Networks via Moment Alignmentcited by 29
Built on by
Citing papers per year: 2022: 1; 2023: 16; 2024: 10; 2025: 13; 2026: 4.
44 papers.
Sort:
By area:
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023On Pitfalls of Test-Time Adaptationcited by 63
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
- 2023Towards Real-World Test-Time Adaptation: Tri-Net Self-Training with Balanced Normalizationcited by 34
- 2023Improving the Generalization of Segmentation Foundation Model under Distribution Shift via Weakly Supervised Adaptationcited by 31
- 2023TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentationcited by 28
- 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentationcited by 20
- 2023Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clustering Regularized Self-Trainingcited by 19
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognitioncited by 15
- 2023What, How, and When Should Object Detectors Update in Continually Changing Test Domains?cited by 15
- 2025Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptationcited by 14
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 13
32 more
- 2023STFAR: Improving Object Detection Robustness at Test-Time by Self-Training with Feature Alignment Regularizationcited by 12
- 2022Towards Understanding GD with Hard and Conjugate Pseudo-labels for Test-Time Adaptationcited by 9
- 2023Online Continual Learning for Robust Indoor Object Recognitioncited by 9
- 2024A Layer Selection Approach to Test Time Adaptationcited by 7
- 2023From Question to Exploration: Test-Time Adaptation in Semantic Segmentation?cited by 5
- 2025Robust Distribution Alignment for Industrial Anomaly Detection under Distribution Shiftcited by 5
- 2024CLIP-Guided Source-Free Object Detection in Aerial Imagescited by 4
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoningcited by 4
- 2025Towards Understanding Extrapolation: a Causal Lenscited by 4
- 2025Adapting In-Domain Few-Shot Segmentation to New Domains without Source Domain Retrainingcited by 4
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Trainingcited by 4
- 2025Test-Time Adaptive Object Detection with Foundation Modelcited by 4
- 2023Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarioscited by 3
- 2025Transforming Future Data Center Operations and Management via Physical AIcited by 3
- 2025Exploring Audio Cues for Enhanced Test-Time Video Model Adaptationcited by 3
- 2024Exploring Human-in-the-Loop Test-Time Adaptation by Synergizing Active Learning and Model Selectioncited by 2
- 2023SODA: Robust Training of Test-Time Data Adaptorscited by 1
- 2024A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspectivecited by 1
- 2024Generalizing Segmentation Foundation Model Under Sim-to-real Domain-shift for Guidewire Segmentation in X-ray Fluoroscopycited by 1
- 2025Augmented Contrastive Clustering with Uncertainty-Aware Prototyping for Time Series Test Time Adaptationcited by 1
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarkingcited by 1
- 2025CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Trainingcited by 1
- 2026FACTOR: Counterfactual Training-Free Test-Time Adaptation for Open-Vocabulary Object Detectioncited by 1
- 2024Mitigating the Bias in the Model for Continual Test-Time Adaptationcited by 0
- 2024Open-World Test-Time Training: Self-Training with Contrast Learningcited by 0
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Trainingcited by 0
- 2024Meta-TTT: A Meta-learning Minimax Framework For Test-Time Trainingcited by 0
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalizationcited by 0
- 2025POEM: Explore Unexplored Reliable Samples to Enhance Test-Time Adaptationcited by 0
- 2026MMD-Balls as Credal Sets: A PAC-Bayesian Framework for Epistemic Uncertainty in Test-Time Adaptationcited by 0
- 2026Sample-wise Targeted Adversarial Attacks on Test-time Adaptationcited by 0
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptationcited by 0
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026Sample-wise Targeted Adversarial Attacks on Test-time Adaptation22 May 2026
- 2026MMD-Balls as Credal Sets: A PAC-Bayesian Framework for Epistemic Uncertainty in Test-Time Adaptation20 May 2026
- 2026FACTOR: Counterfactual Training-Free Test-Time Adaptation for Open-Vocabulary Object Detection5 May 2026
- 2025CoTBox-TTT: Grounding Medical VQA with Visual Chain-of-Thought Boxes During Test-time Training16 Nov 2025
- 2025Test-Time Adaptive Object Detection with Foundation Model29 Oct 2025
- 2025POEM: Explore Unexplored Reliable Samples to Enhance Test-Time Adaptation26 Sep 2025
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarking2 Sep 2025
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization22 Jul 2025
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training10 Jul 2025
- 2025Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptation18 Jun 2025
- 2025Exploring Audio Cues for Enhanced Test-Time Video Model Adaptation14 Jun 2025
32 more
- 2025Adapting In-Domain Few-Shot Segmentation to New Domains without Source Domain Retraining30 Apr 2025
- 2025Transforming Future Data Center Operations and Management via Physical AI7 Apr 2025
- 2025Robust Distribution Alignment for Industrial Anomaly Detection under Distribution Shift19 Mar 2025
- 2025Towards Understanding Extrapolation: a Causal Lens15 Jan 2025
- 2025Augmented Contrastive Clustering with Uncertainty-Aware Prototyping for Time Series Test Time Adaptation1 Jan 2025
- 2024Generalizing Segmentation Foundation Model Under Sim-to-real Domain-shift for Guidewire Segmentation in X-ray Fluoroscopy9 Oct 2024
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoning7 Oct 2024
- 2024Meta-TTT: A Meta-learning Minimax Framework For Test-Time Training2 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Open-World Test-Time Training: Self-Training with Contrast Learning15 Sep 2024
- 2024Exploring Human-in-the-Loop Test-Time Adaptation by Synergizing Active Learning and Model Selection29 May 2024
- 2024A Layer Selection Approach to Test Time Adaptation4 Apr 2024
- 2024Mitigating the Bias in the Model for Continual Test-Time Adaptation2 Mar 2024
- 2024A Comprehensive Review of Machine Learning Advances on Data Change: A Cross-Field Perspective20 Feb 2024
- 2024CLIP-Guided Source-Free Object Detection in Aerial Images10 Jan 2024
- 2023What, How, and When Should Object Detectors Update in Continually Changing Test Domains?12 Dec 2023
- 2023Improving the Generalization of Segmentation Foundation Model under Distribution Shift via Weakly Supervised Adaptation6 Dec 2023
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognition28 Oct 2023
- 2023SODA: Robust Training of Test-Time Data Adaptors17 Oct 2023
- 2023From Question to Exploration: Test-Time Adaptation in Semantic Segmentation?9 Oct 2023
- 2023Generalized Robust Test-Time Adaptation in Continuous Dynamic Scenarios7 Oct 2023
- 2023Towards Real-World Test-Time Adaptation: Tri-Net Self-Training with Balanced Normalization26 Sep 2023
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansion19 Aug 2023
- 2023Online Continual Learning for Robust Indoor Object Recognition19 Jul 2023
- 2023On Pitfalls of Test-Time Adaptation6 Jun 2023
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraints10 Apr 2023
- 2023STFAR: Improving Object Detection Robustness at Test-Time by Self-Training with Feature Alignment Regularization31 Mar 2023
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts27 Mar 2023
- 2023Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clustering Regularized Self-Training20 Mar 2023
- 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentation18 Mar 2023
- 2023TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentation17 Mar 2023
- 2022Towards Understanding GD with Hard and Conjugate Pseudo-labels for Test-Time Adaptation18 Oct 2022
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023On Pitfalls of Test-Time Adaptationcited by 63
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
- 2023Towards Real-World Test-Time Adaptation: Tri-Net Self-Training with Balanced Normalizationcited by 34
- 2023Improving the Generalization of Segmentation Foundation Model under Distribution Shift via Weakly Supervised Adaptationcited by 31
- 2023TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentationcited by 28
- 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentationcited by 20
- 2023Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clustering Regularized Self-Trainingcited by 19
- 2023Optimization-Free Test-Time Adaptation for Cross-Person Activity Recognitioncited by 15
- 2023What, How, and When Should Object Detectors Update in Continually Changing Test Domains?cited by 15
- 2025Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptationcited by 14
- 2023Evaluation of Test-Time Adaptation Under Computational Time Constraintscited by 13
12 most cited of 42 All 42 (JSON)
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026Sample-wise Targeted Adversarial Attacks on Test-time Adaptation22 May 2026
- 2026MMD-Balls as Credal Sets: A PAC-Bayesian Framework for Epistemic Uncertainty in Test-Time Adaptation20 May 2026
- 2026FACTOR: Counterfactual Training-Free Test-Time Adaptation for Open-Vocabulary Object Detection5 May 2026
- 2025Test-Time Adaptive Object Detection with Foundation Model29 Oct 2025
- 2025POEM: Explore Unexplored Reliable Samples to Enhance Test-Time Adaptation26 Sep 2025
- 2025ADVMEM: Adversarial Memory Initialization for Realistic Test-Time Adaptation via Tracklet-Based Benchmarking2 Sep 2025
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization22 Jul 2025
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training10 Jul 2025
- 2025Learning to Adapt Frozen CLIP for Few-Shot Test-Time Domain Adaptation18 Jun 2025
- 2025Exploring Audio Cues for Enhanced Test-Time Video Model Adaptation14 Jun 2025
- 2025Adapting In-Domain Few-Shot Segmentation to New Domains without Source Domain Retraining30 Apr 2025
12 newest of 42 All 42 (JSON)