mlsanityData to 7 Oct 2026

CLIP-Powered Domain Generalization and Domain Adaptation: A Comprehensive Survey

arXiv 2504.14280 ↗First posted 19 Apr 2025cs.CV cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for improving model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a central role in these tasks, offering strong zero-shot capabilities that allow models to operate effectively in unseen domains. Yet, despite CLIP's growing influence, no comprehensive survey has systematically examined its applications in DG and DA, underscoring the need for this review. This survey provides a unified and in-depth overview of CLIP-driven DG and DA. Before reviewing methods, we establish precise and complete scenario definitions covering source accessibility (SA vs. SF), source number (SS vs. MS), and label relations (CS, PS, OS, OPS), forming a coherent taxonomy that structures all subsequent analyses. For DG, we categorize methods into prompt optimization techniques that enhance task alignment and architectures that leverage CLIP as a backbone for transferable feature extraction. For DA, we examine both source-available approaches that rely on labeled source data and source-free approaches operating primarily on target-domain samples, emphasizing the knowledge transfer mechanisms that enable adaptation across heterogeneous settings. We further provide consolidated trend analyses for both DG and DA, revealing overarching patterns, methodological principles, and scenario-dependent behaviors. We then discuss key challenges such as realistic deployment scenarios, LLM knowledge integration, multimodal fusion, interpretability, and catastrophic forgetting, and outline future directions for developing scalable and trustworthy CLIP-based DG and DA systems. This survey offers actionable insights for advancing CLIP-based domain robustness in real-world scenarios.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 169 of its 245 references that are in the map. First posted on arXiv 19 Apr 2025.

Builds on

169 of 245 references.

References · 169

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  8. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  11. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  12. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
38 more
  1. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  4. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  8. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  9. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  10. 2013Describing Textures in the Wildcited by 2,110
  11. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  12. 2019Language Models as Knowledge Bases?cited by 1,922
  13. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
  14. 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
  15. 2022Visual Prompt Tuningcited by 1,674
  16. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,507
  17. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  18. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  19. 2019Natural Adversarial Examplescited by 1,401
  20. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  21. 2018Moment Matching for Multi-Source Domain Adaptationcited by 1,327
  22. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  23. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  24. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  25. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
  26. 2020In Search of Lost Domain Generalizationcited by 1,042
  27. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
  28. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  29. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  30. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  31. 2019How Can We Know What Language Models Know?cited by 953
  32. 2021Florence: A New Foundation Model for Computer Visioncited by 802
  33. 2021Robust fine-tuning of zero-shot modelscited by 785
  34. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  35. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  36. 2022MaPLe: Multi-modal Prompt Learningcited by 685
  37. 2021Multimodal Few-Shot Learning with Frozen Language Modelscited by 657
  38. 2018Recognition in Terra Incognitacited by 655

50 most cited of 169 All 169 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area: