DIRA-SS:Dynamic Domain Incremental Regularised Adaptation -- Self-Supervised
Not on the map. Why?
Abstract (arXiv)
Autonomous systems (AS) often rely on Deep Neural Network (DNN) classifiers to operate in complex and dynamically changing environments. However, during operation, these classifiers may encounter domains that differ from those seen during development, causing performance degradation under distribution shift. Removing systems from operation for labelled data collection and retraining is often impractical, particularly when adaptation must occur quickly and at scale. This paper introduces DIRA-SS, a self-supervised extension of Dynamic Incremental Regularised Adaptation (DIRA) that enables online domain adaptation using only a small number of unlabelled target-domain samples. DIRA-SS augments an existing classifier with an auxiliary retraining branch and adapts the shared feature representation through a rotation-prediction task, while elastic weight consolidation regularises important source-domain parameters to reduce destructive updates. This allows the model to benefit from transfer learning without requiring classification labels during operation. We evaluate DIRA-SS on CIFAR-10C, CIFAR-100C, and ImageNet-C using ResNet architectures under severe common corruptions. The results show that DIRA-SS substantially improves performance over the non-adapted source model, achieves accuracy close to the supervised DIRA method, and outperforms existing unsupervised test-time adaptation baselines on ImageNet-C when using only 100 target-domain samples.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 27 references that are in the map. First posted on arXiv 13 Nov 2023.
Builds on
19 of 27 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,857
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2021Domain Generalization: A Surveycited by 760
- 2013An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networkscited by 711
- 2020Improving robustness against common corruptions by covariate shift adaptationcited by 427
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2019Episodic Training for Domain Generalizationcited by 245
7 more
- 2020Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shiftcited by 235
- 2022Test-Time Training with Masked Autoencoderscited by 208
- 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2019Unsupervised Domain Adaptation through Self-Supervisioncited by 116
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2017AutoDIAL: Automatic DomaIn Alignment Layerscited by 75
Built on by
Not cited yet.