On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansion
Not on the map. Why?
Abstract (arXiv)
Generalizing deep learning models to unknown target domain distribution with low latency has motivated research into test-time training/adaptation (TTT/TTA). Existing approaches often focus on improving test-time training performance under well-curated target domain data. As figured out in this work, many state-of-the-art methods fail to maintain the performance when the target domain is contaminated with strong out-of-distribution (OOD) data, a.k.a. open-world test-time training (OWTTT). The failure is mainly due to the inability to distinguish strong OOD samples from regular weak OOD samples. To improve the robustness of OWTTT we first develop an adaptive strong OOD pruning which improves the efficacy of the self-training TTT method. We further propose a way to dynamically expand the prototypes to represent strong OOD samples for an improved weak/strong OOD data separation. Finally, we regularize self-training with distribution alignment and the combination yields the state-of-the-art performance on 5 OWTTT benchmarks. The code is available at https://github.com/Yushu-Li/OWTTT.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 19 Aug 2023.
Builds on
33 of 51 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
- 2018Deep Visual Domain Adaptation: A Surveycited by 635
- 2022Continual Test-Time Domain Adaptationcited by 525
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 510
21 more
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 469
- 2017VisDA: The Visual Domain Adaptation Challengecited by 435
- 2023Towards Stable Test-Time Adaptation in Dynamic Wild Worldcited by 415
- 2018Recent Advances in Open Set Recognition: A Surveycited by 310
- 2022Contrastive Test-Time Adaptationcited by 261
- 2019Adversarial Domain Adaptation with Domain Mixupcited by 250
- 2018Do CIFAR-10 Classifiers Generalize to CIFAR-10?cited by 200
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 151
- 2018Open Set Domain Adaptation by Backpropagationcited by 150
- 2021Cycle Self-Training for Domain Adaptationcited by 120
- 2021Source-free Domain Adaptation via Avatar Prototype Generation and Adaptationcited by 111
- 2019Infinite Mixture Prototypes for Few-Shot Learningcited by 99
- 2022Test-Time Adaptation via Conjugate Pseudo-labelscited by 98
- 2022Source-Free Domain Adaptation via Distribution Estimationcited by 97
- 2022Benchmarking Robustness of 3D Point Cloud Recognition Against Common Corruptionscited by 80
- 2019Discriminative Adversarial Domain Adaptationcited by 74
- 2022Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain Adaptationcited by 66
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2019Open Set Domain Adaptation: Theoretical Bound and Algorithmcited by 48
- 2022Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clusteringcited by 44
- 2020Hypothesis Disparity Regularized Mutual Information Maximizationcited by 15
Built on by
Citing papers per year: 2023: 2; 2024: 11; 2025: 12; 2026: 9.
34 papers.
Sort:
By area:
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2024Unified Entropy Optimization for Open-Set Test-Time Adaptationcited by 19
- 2024STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replaycited by 13
- 2025Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimizationcited by 12
- 2025Noisy Test-Time Adaptation in Vision-Language Modelscited by 10
- 2025Generalized Incremental Learning under Concept Drift across Evolving Data Streamscited by 7
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Trainingcited by 5
- 2023Continual Adversarial Defensecited by 4
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Modelcited by 4
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoningcited by 4
- 2025Towards Understanding Extrapolation: a Causal Lenscited by 4
22 more
- 2024Efficient Open Set Single Image Test Time Adaptation of Vision Language Modelscited by 3
- 2025Test-Time Adaptation with Binary Feedbackcited by 3
- 2023Mixture-of-Experts for Open Set Domain Adaptation: A Dual-Space Detection Approachcited by 2
- 2024COMET: Contrastive Mean Teacher for Online Source-Free Universal Domain Adaptationcited by 2
- 2024Exploring Human-in-the-Loop Test-Time Adaptation by Synergizing Active Learning and Model Selectioncited by 2
- 2024Covariance-based Space Regularization for Few-shot Class Incremental Learningcited by 2
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Modelscited by 2
- 2026Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMscited by 2
- 2024Improving Batch Normalization with TTA for Robust Object Detection in Self-Drivingcited by 1
- 2025From Pixel to Mask: A Survey of Out-of-Distribution Segmentationcited by 1
- 2025Instance-Aware Test-Time Segmentation for Continual Domain Shiftscited by 1
- 2026TALON: Test-time Adaptive Learning for On-the-Fly Category Discoverycited by 1
- 2026Mitigating the ID-OOD Tradeoff in Open-Set Test-Time Adaptationcited by 1
- 2024Open-World Test-Time Training: Self-Training with Contrast Learningcited by 0
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalizationcited by 0
- 2025Hierarchical Adaptive networks with Task vectors for Test-Time Adaptationcited by 0
- 2025Segmentation Assisted Incremental Test Time Adaptation in an Open Worldcited by 0
- 2026PlugSI: Plug-and-Play Test-Time Graph Adaptation for Spatial Interpolationcited by 0
- 2026DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detectioncited by 0
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shiftscited by 0
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptationcited by 0
- 2026Test-Time Generalized Category Discoverycited by 0
- 2026Test-Time Generalized Category Discovery27 Sep 2026
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMs24 Jun 2026
- 2026DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detection26 Apr 2026
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Models17 Apr 2026
- 2026Mitigating the ID-OOD Tradeoff in Open-Set Test-Time Adaptation2 Apr 2026
- 2026TALON: Test-time Adaptive Learning for On-the-Fly Category Discovery9 Mar 2026
- 2026PlugSI: Plug-and-Play Test-Time Graph Adaptation for Spatial Interpolation10 Feb 2026
- 2025Instance-Aware Test-Time Segmentation for Continual Domain Shifts9 Dec 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025Segmentation Assisted Incremental Test Time Adaptation in an Open World27 Aug 2025
22 more
- 2025From Pixel to Mask: A Survey of Out-of-Distribution Segmentation14 Aug 2025
- 2025Hierarchical Adaptive networks with Task vectors for Test-Time Adaptation11 Aug 2025
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization22 Jul 2025
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Training10 Jul 2025
- 2025Generalized Incremental Learning under Concept Drift across Evolving Data Streams6 Jun 2025
- 2025Test-Time Adaptation with Binary Feedback24 May 2025
- 2025Noisy Test-Time Adaptation in Vision-Language Models20 Feb 2025
- 2025Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization23 Jan 2025
- 2025Towards Understanding Extrapolation: a Causal Lens15 Jan 2025
- 2024Improving Batch Normalization with TTA for Robust Object Detection in Self-Driving28 Nov 2024
- 2024Covariance-based Space Regularization for Few-shot Class Incremental Learning2 Nov 2024
- 2024On the Adversarial Risk of Test Time Adaptation: An Investigation into Realistic Test-Time Data Poisoning7 Oct 2024
- 2024Open-World Test-Time Training: Self-Training with Contrast Learning15 Sep 2024
- 2024STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replay22 Jul 2024
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Model19 Jul 2024
- 2024Efficient Open Set Single Image Test Time Adaptation of Vision Language Models1 Jun 2024
- 2024Exploring Human-in-the-Loop Test-Time Adaptation by Synergizing Active Learning and Model Selection29 May 2024
- 2024Unified Entropy Optimization for Open-Set Test-Time Adaptation9 Apr 2024
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memory15 Mar 2024
- 2024COMET: Contrastive Mean Teacher for Online Source-Free Universal Domain Adaptation31 Jan 2024
- 2023Continual Adversarial Defense15 Dec 2023
- 2023Mixture-of-Experts for Open Set Domain Adaptation: A Dual-Space Detection Approach1 Nov 2023
- 2025Noisy Test-Time Adaptation in Vision-Language Modelscited by 10
- 2024Efficient Open Set Single Image Test Time Adaptation of Vision Language Modelscited by 3
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Modelscited by 2
- 2026Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMscited by 2
- 2026DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detectioncited by 0
- 2026Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMs24 Jun 2026
- 2026DynProto: Dynamic Prototype Evolution for Out-of-Distribution Detection26 Apr 2026
- 2026TTL: Test-time Textual Learning for OOD Detection with Pretrained Vision-Language Models17 Apr 2026
- 2025Noisy Test-Time Adaptation in Vision-Language Models20 Feb 2025
- 2024Efficient Open Set Single Image Test Time Adaptation of Vision Language Models1 Jun 2024
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2024T4P: Test-Time Training of Trajectory Prediction via Masked Autoencoder and Actor-specific Token Memorycited by 20
- 2024Unified Entropy Optimization for Open-Set Test-Time Adaptationcited by 19
- 2024STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replaycited by 13
- 2025Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimizationcited by 12
- 2025Generalized Incremental Learning under Concept Drift across Evolving Data Streamscited by 7
- 2025Synchronizing Task Behavior: Aligning Multiple Tasks during Test-Time Trainingcited by 5
- 2023Continual Adversarial Defensecited by 4
- 2024Memory-Efficient Pseudo-Labeling for Online Source-Free Universal Domain Adaptation using a Gaussian Mixture Modelcited by 4
- 2025Towards Understanding Extrapolation: a Causal Lenscited by 4
- 2025Test-Time Adaptation with Binary Feedbackcited by 3
- 2024COMET: Contrastive Mean Teacher for Online Source-Free Universal Domain Adaptationcited by 2
12 most cited of 27 All 27 (JSON)
- 2026Test-Time Generalized Category Discovery27 Sep 2026
- 2026Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation20 Aug 2026
- 2026COSTA: A Cluster-Centric Paradigm for Annotation-Free Open-Set Semantic Segmentation of Aerial Point Clouds with Domain Shifts19 Aug 2026
- 2026Mitigating the ID-OOD Tradeoff in Open-Set Test-Time Adaptation2 Apr 2026
- 2026TALON: Test-time Adaptive Learning for On-the-Fly Category Discovery9 Mar 2026
- 2026PlugSI: Plug-and-Play Test-Time Graph Adaptation for Spatial Interpolation10 Feb 2026
- 2025Instance-Aware Test-Time Segmentation for Continual Domain Shifts9 Dec 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025Segmentation Assisted Incremental Test Time Adaptation in an Open World27 Aug 2025
- 2025From Pixel to Mask: A Survey of Out-of-Distribution Segmentation14 Aug 2025
- 2025Hierarchical Adaptive networks with Task vectors for Test-Time Adaptation11 Aug 2025
- 2025Should Bias be Eliminated? A General Framework to Use Bias for OOD Generalization22 Jul 2025
12 newest of 27 All 27 (JSON)