Unsupervised Domain Adaptation within Deep Foundation Latent Spaces
Not on the map. Why?
Abstract (arXiv)
The vision transformer-based foundation models, such as ViT or Dino-V2, are aimed at solving problems with little or no finetuning of features. Using a setting of prototypical networks, we analyse to what extent such foundation models can solve unsupervised domain adaptation without finetuning over the source or target domain. Through quantitative analysis, as well as qualitative interpretations of decision making, we demonstrate that the suggested method can improve upon existing baselines, as well as showcase the limitations of such approach yet to be solved.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 23 references that are in the map. First posted on arXiv 22 Feb 2024.
Builds on
20 of 23 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,331
- 2017Adversarial Discriminative Domain Adaptationcited by 1,311
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
8 more
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2022Revisiting Weakly Supervised Pre-Training of Visual Perception Modelscited by 116
- 2022B-cos Networks: Alignment is All We Need for Interpretabilitycited by 88
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 86
- 2021Delving Deep into the Generalization of Vision Transformers under Distribution Shiftscited by 85
- 2019Towards Explainable Deep Neural Networks (xDNN)cited by 61
- 2021Adversarial Unsupervised Domain Adaptation with Conditional and Label Shift: Infer, Align and Iteratecited by 43
- 2023Towards interpretable-by-design deep learning algorithmscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026FlashSinkhorn: IO-Aware Entropic Optimal Transport on GPUcited by 11