Open-World Test-Time Training: Self-Training with Contrast Learning
Not on the map. Why?
Abstract (arXiv)
Traditional test-time training (TTT) methods, while addressing domain shifts, often assume a consistent class set, limiting their applicability in real-world scenarios characterized by infinite variety. Open-World Test-Time Training (OWTTT) addresses the challenge of generalizing deep learning models to unknown target domain distributions, especially in the presence of strong Out-of-Distribution (OOD) data. Existing TTT methods often struggle to maintain performance when confronted with strong OOD data. In OWTTT, the focus has predominantly been on distinguishing between overall strong and weak OOD data. However, during the early stages of TTT, initial feature extraction is hampered by interference from strong OOD and corruptions, resulting in diminished contrast and premature classification of certain classes as strong OOD. To address this, we introduce Open World Dynamic Contrastive Learning (OWDCL), an innovative approach that utilizes contrastive learning to augment positive sample pairs. This strategy not only bolsters contrast in the early stages but also significantly enhances model robustness in subsequent stages. In comparison datasets, our OWDCL model has produced the most advanced performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 43 references that are in the map. First posted on arXiv 15 Sep 2024.
Builds on
28 of 43 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
- 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 844
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2015Towards Open Set Deep Networkscited by 533
16 more
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2015Deep Speech 2: End-to-End Speech Recognition in English and Mandarincited by 449
- 2018Recent Advances in Open Set Recognition: A Surveycited by 309
- 2014Towards Open World Recognitioncited by 226
- 2020Universal Source-Free Domain Adaptationcited by 219
- 2021Generalized Source-free Domain Adaptationcited by 175
- 2021Source-Free Domain Adaptation for Semantic Segmentationcited by 168
- 2018Open Set Domain Adaptation by Backpropagationcited by 150
- 2021Cycle Self-Training for Domain Adaptationcited by 120
- 2021MT3: Meta Test-Time Training for Self-Supervised Test-Time Adaptioncited by 65
- 2022Evaluating the Adversarial Robustness of Adaptive Test-time Defensescited by 64
- 2022Revisiting Realistic Test-Time Training: Sequential Inference and Adaptation by Anchored Clusteringcited by 44
- 2022ActMAD: Activation Matching to Align Distributions for Test-Time-Trainingcited by 38
- 2023On the Robustness of Open-World Test-Time Training: Self-Training with Dynamic Prototype Expansioncited by 34
- 2022TeST: Test-time Self-Training under Distribution Shiftcited by 29
- 2023Singular Value Penalization and Semantic Data Augmentation for Fully Test-Time Adaptationcited by 2
Built on by
Not cited yet.