Test-Time Training with Self-Supervision for Generalization under Distribution Shifts
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose Test-Time Training, a general approach for improving the performance of predictive models when training and test data come from different distributions. We turn a single unlabeled test sample into a self-supervised learning problem, on which we update the model parameters before making a prediction. This also extends naturally to data in an online stream. Our simple approach leads to improvements on diverse image classification benchmarks aimed at evaluating robustness to distribution shifts.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 13; 2023: 6; 2024: 8; 2025: 13; 2026: 4.
55 papers.
Sort:
By area:
- 2025TTRL: Test-Time Reinforcement Learningcited by 253
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2022Visual Prompt Tuning for Test-time Domain Adaptationcited by 97
- 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
- 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphscited by 69
- 2021Test-time Batch Statistics Calibration for Covariate Shiftcited by 50
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptationcited by 50
- 2021Noether Networks: Meta-Learning Useful Conserved Quantitiescited by 26
- 2022Debiased Graph Neural Networks with Agnostic Label Selection Biascited by 25
- 2021Fighting Gradients with Gradients: Dynamic Defenses against Adversarial Attackscited by 19
38 more
- 2021Test-Time Training for Deformable Multi-Scale Image Registrationcited by 17
- 2022Test-Time Training for Graph Neural Networkscited by 17
- 2022Few-Shot Adaptation of Pre-Trained Networks for Domain Shiftcited by 16
- 2024Dual Test-time Training for Out-of-distribution Recommender Systemcited by 16
- 2025The Future of Continual Learning in the Era of Foundation Models: Three Key Directionscited by 16
- 2021On-target Adaptationcited by 15
- 2023MoVie: Visual Model-Based Policy Adaptation for View Generalizationcited by 15
- 2022Self-Adaptive Forecasting for Improved Deep Learning on Non-Stationary Time-Seriescited by 14
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issuescited by 12
- 2021AUGCO: Augmentation Consistency-guided Self-training for Source-free Domain Adaptive Semantic Segmentationcited by 11
- 2023VPA: Fully Test-Time Visual Prompt Adaptationcited by 11
- 2025SPINE: Token-Selective Test-Time Reinforcement Learning with Entropy-Band Regularizationcited by 11
- 2024CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Trainingcited by 9
- 2025Learning from Streaming Video with Orthogonal Gradientscited by 9
- 2021Image Restoration by Deep Projected GSUREcited by 8
- 2025Don't throw the baby out with the bathwater: How and why deep learning for ARCcited by 7
- 2024No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representationscited by 5
- 2025Progressive Test Time Energy Adaptation for Medical Image Segmentationcited by 5
- 2024Test-Time Training on Graphs with Large Language Models (LLMs)cited by 3
- 2025How Far Can LLMs Improve from Experience? Measuring Test-Time Learning Ability in LLMs with Human Comparisoncited by 3
- 2022FUSION: Fully Unsupervised Test-Time Stain Adaptation via Fused Normalization Statisticscited by 2
- 2022Adversarial and Random Transformations for Robust Domain Adaptation and Generalizationcited by 2
- 2022Electricity Consumption Forecasting for Out-of-distribution Time-of-Use Tariffscited by 1
- 2022EiHi Net: Out-of-Distribution Generalization Paradigmcited by 1
- 2023Detecting and Learning Out-of-Distribution Data in the Open world: Algorithm and Theorycited by 1
- 2025Rectifying Adversarial Sample with Low Entropy Prior for Test-Time Defensecited by 1
- 2025NeuroTTT: Bridging Pretraining-Downstream Task Misalignment in EEG Foundation Models via Test-Time Trainingcited by 1
- 2026Self-Soupervision: Cooking Model Soups without Labelscited by 1
- 2026Dual Consensus: Escaping from Spurious Majority in Unsupervised RLVR via Two-Stage Vote Mechanismcited by 1
- 2021Interpretable Self-supervised Multi-task Learning for COVID-19 Information Retrieval and Extractioncited by 0
- 2022elBERto: Self-supervised Commonsense Learning for Question Answeringcited by 0
- 2022A Novel Plug-and-Play Approach for Adversarially Robust Generalizationcited by 0
- 2022Context-Adaptive Deep Neural Networks via Bridge-Mode Connectivitycited by 0
- 2024Adversarial Reweighting with α-Power Maximization for Domain Adaptationcited by 0
- 2024Less is More: Pseudo-Label Filtering for Continual Test-Time Adaptationcited by 0
- 2024Source-Free Test-Time Adaptation For Online Surface-Defect Detectioncited by 0
- 2024Functional Risk Minimizationcited by 0
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancementcited by 0
50 most cited of 55 All 55 (JSON)
- 2026Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits8 Oct 2026
- 2026Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation4 Sep 2026
- 2026Dual Consensus: Escaping from Spurious Majority in Unsupervised RLVR via Two-Stage Vote Mechanism17 Mar 2026
- 2026Self-Soupervision: Cooking Model Soups without Labels2 Feb 2026
- 2025SPINE: Token-Selective Test-Time Reinforcement Learning with Entropy-Band Regularization22 Nov 2025
- 2025NeuroTTT: Bridging Pretraining-Downstream Task Misalignment in EEG Foundation Models via Test-Time Training30 Sep 2025
- 2025Test-Time Warmup for Multimodal Large Language Models12 Sep 2025
- 2025Rectifying Adversarial Sample with Low Entropy Prior for Test-Time Defense4 Jul 2025
- 2025T3DM: Test-Time Training-Guided Distribution Shift Modelling for Temporal Knowledge Graph Reasoning2 Jul 2025
- 2025How Far Can LLMs Improve from Experience? Measuring Test-Time Learning Ability in LLMs with Human Comparison17 Jun 2025
- 2025Don't throw the baby out with the bathwater: How and why deep learning for ARC17 Jun 2025
- 2025The Future of Continual Learning in the Era of Foundation Models: Three Key Directions3 Jun 2025
38 more
- 2025Symmetry-Breaking Descent for Invariant Cost Functionals19 May 2025
- 2025TTRL: Test-Time Reinforcement Learning22 Apr 2025
- 2025Learning from Streaming Video with Orthogonal Gradients2 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025Progressive Test Time Energy Adaptation for Medical Image Segmentation20 Mar 2025
- 2024Functional Risk Minimization30 Dec 2024
- 2024CustomTTT: Motion and Appearance Customized Video Generation via Test-Time Training20 Dec 2024
- 2024Source-Free Test-Time Adaptation For Online Surface-Defect Detection18 Aug 2024
- 2024Dual Test-time Training for Out-of-distribution Recommender System22 Jul 2024
- 2024No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations15 Jul 2024
- 2024Less is More: Pseudo-Label Filtering for Continual Test-Time Adaptation3 Jun 2024
- 2024Adversarial Reweighting with α-Power Maximization for Domain Adaptation26 Apr 2024
- 2024Test-Time Training on Graphs with Large Language Models (LLMs)21 Apr 2024
- 2023Detecting and Learning Out-of-Distribution Data in the Open world: Algorithm and Theory10 Oct 2023
- 2023VPA: Fully Test-Time Visual Prompt Adaptation26 Sep 2023
- 2023MoVie: Visual Model-Based Policy Adaptation for View Generalization3 Jul 2023
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptation8 Jun 2023
- 2023Domain Generalization in Machine Learning Models for Wireless Communications: Concepts, State-of-the-Art, and Open Issues13 Mar 2023
- 2023A Comprehensive Survey on Source-free Domain Adaptation23 Feb 2023
- 2022Context-Adaptive Deep Neural Networks via Bridge-Mode Connectivity28 Nov 2022
- 2022Adversarial and Random Transformations for Robust Domain Adaptation and Generalization13 Nov 2022
- 2022Test-Time Training for Graph Neural Networks17 Oct 2022
- 2022Visual Prompt Tuning for Test-time Domain Adaptation10 Oct 2022
- 2022EiHi Net: Out-of-Distribution Generalization Paradigm29 Sep 2022
- 2022FUSION: Fully Unsupervised Test-Time Stain Adaptation via Fused Normalization Statistics30 Aug 2022
- 2022A Novel Plug-and-Play Approach for Adversarially Robust Generalization19 Aug 2022
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptation7 Jul 2022
- 2022Few-Shot Adaptation of Pre-Trained Networks for Domain Shift30 May 2022
- 2022elBERto: Self-supervised Commonsense Learning for Question Answering17 Mar 2022
- 2022Electricity Consumption Forecasting for Out-of-distribution Time-of-Use Tariffs11 Feb 2022
- 2022Self-Adaptive Forecasting for Improved Deep Learning on Non-Stationary Time-Series4 Feb 2022
- 2022Debiased Graph Neural Networks with Agnostic Label Selection Bias19 Jan 2022
- 2021Noether Networks: Meta-Learning Useful Conserved Quantities6 Dec 2021
- 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphs20 Nov 2021
- 2021Test-time Batch Statistics Calibration for Covariate Shift6 Oct 2021
- 2021On-target Adaptation2 Sep 2021
- 2021AUGCO: Augmentation Consistency-guided Self-training for Source-free Domain Adaptive Semantic Segmentation21 Jul 2021
- 2021Interpretable Self-supervised Multi-task Learning for COVID-19 Information Retrieval and Extraction15 Jun 2021
50 newest of 55 All 55 (JSON)
- 2025TTRL: Test-Time Reinforcement Learningcited by 253
- 2025SPINE: Token-Selective Test-Time Reinforcement Learning with Entropy-Band Regularizationcited by 11
- 2026Dual Consensus: Escaping from Spurious Majority in Unsupervised RLVR via Two-Stage Vote Mechanismcited by 1
- 2026Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendationcited by 0
- 2026Distill Globally, Adapt Locally: Reasoning Distillation and Product-Type Test-Time Training for Scalable Trade-Up Recommendation4 Sep 2026
- 2026Dual Consensus: Escaping from Spurious Majority in Unsupervised RLVR via Two-Stage Vote Mechanism17 Mar 2026
- 2025SPINE: Token-Selective Test-Time Reinforcement Learning with Entropy-Band Regularization22 Nov 2025
- 2025TTRL: Test-Time Reinforcement Learning22 Apr 2025
- 2025Test-Time Warmup for Multimodal Large Language Modelscited by 0
- 2025Test-Time Warmup for Multimodal Large Language Models12 Sep 2025
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2022Visual Prompt Tuning for Test-time Domain Adaptationcited by 97
- 2021Break-It-Fix-It: Unsupervised Learning for Program Repaircited by 71
- 2022Back to the Source: Diffusion-Driven Test-Time Adaptationcited by 71
- 2021Generalizing Graph Neural Networks on Out-Of-Distribution Graphscited by 69
- 2021Test-time Batch Statistics Calibration for Covariate Shiftcited by 50
- 2023RDumb: A simple approach that questions our progress in continual test-time adaptationcited by 50
- 2021Noether Networks: Meta-Learning Useful Conserved Quantitiescited by 26
- 2022Debiased Graph Neural Networks with Agnostic Label Selection Biascited by 25
- 2021Fighting Gradients with Gradients: Dynamic Defenses against Adversarial Attackscited by 19
- 2021Test-Time Training for Deformable Multi-Scale Image Registrationcited by 17
12 most cited of 49 All 49 (JSON)
- 2026Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits8 Oct 2026
- 2026Self-Soupervision: Cooking Model Soups without Labels2 Feb 2026
- 2025NeuroTTT: Bridging Pretraining-Downstream Task Misalignment in EEG Foundation Models via Test-Time Training30 Sep 2025
- 2025Rectifying Adversarial Sample with Low Entropy Prior for Test-Time Defense4 Jul 2025
- 2025T3DM: Test-Time Training-Guided Distribution Shift Modelling for Temporal Knowledge Graph Reasoning2 Jul 2025
- 2025How Far Can LLMs Improve from Experience? Measuring Test-Time Learning Ability in LLMs with Human Comparison17 Jun 2025
- 2025Don't throw the baby out with the bathwater: How and why deep learning for ARC17 Jun 2025
- 2025The Future of Continual Learning in the Era of Foundation Models: Three Key Directions3 Jun 2025
- 2025Symmetry-Breaking Descent for Invariant Cost Functionals19 May 2025
- 2025Learning from Streaming Video with Orthogonal Gradients2 Apr 2025
- 2025GISE-TTT:A Framework for Global InformationSegmentation and Enhancement1 Apr 2025
- 2025Progressive Test Time Energy Adaptation for Medical Image Segmentation20 Mar 2025
12 newest of 49 All 49 (JSON)