mlsanityData to 14 Oct 2026

FrogDogNet: Fourier frequency Retained visual prompt Output Guidance for Domain Generalization of CLIP in Remote Sensing

arXiv 2504.16433 ↗First posted 23 Apr 2025cs.CVcited by 2

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

In recent years, large-scale vision-language models (VLMs) like CLIP have gained attention for their zero-shot inference using instructional text prompts. While these models excel in general computer vision, their potential for domain generalization in remote sensing (RS) remains underexplored. Existing approaches enhance prompt learning by generating visual prompt tokens but rely on full-image features, introducing noise and background artifacts that vary within a class, causing misclassification. To address this, we propose FrogDogNet, a novel prompt learning framework integrating Fourier frequency filtering and self-attention to improve RS scene classification and domain generalization. FrogDogNet selectively retains invariant low-frequency components while eliminating noise and irrelevant backgrounds, ensuring robust feature representation across domains. The model first extracts significant features via projection and self-attention, then applies frequency-based filtering to preserve essential structural information for prompt learning. Extensive experiments on four RS datasets and three domain generalization tasks show that FrogDogNet consistently outperforms state-of-the-art prompt learning methods, demonstrating superior adaptability across domain shifts. Our findings highlight the effectiveness of frequency-based invariant feature retention in generalization, paving the way for broader applications. Our code is available at https://github.com/HariseetharamG/FrogDogNet

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 72 of its 139 references that are in the map. First posted on arXiv 23 Apr 2025.

Builds on

72 of 139 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025FedRSClip: Federated Learning for Remote Sensing Scene Classification Using Vision-Language Models5 Jan
  2. 2024Efficient Prompt Tuning of Large Vision-Language Model for Fine-Grained Ship Classification13 Mar
  3. 2023C-SAW: Self-Supervised Prompt Learning for Image Generalization in Remote Sensing27 Nov
  4. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  5. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
  6. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May
  7. 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIP12 Apr

Other references · 65

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  7. 2013Intriguing properties of neural networkscited by 5,155
  8. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  9. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  10. 2015Domain-Adversarial Training of Neural Networkscited by 3,044
  11. 2015VQA: Visual Question Answeringcited by 2,506
  12. 2021Learning to Prompt for Vision-Language Modelscited by 2,281
38 more
  1. 2019Language Models as Knowledge Bases?cited by 1,936
  2. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  3. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  4. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  5. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
  6. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  7. 2021Florence: A New Foundation Model for Computer Visioncited by 804
  8. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  9. 2021Domain Generalization: A Surveycited by 764
  10. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  11. 2022MaPLe: Multi-modal Prompt Learningcited by 687
  12. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
  13. 2021Domain Generalization with MixStylecited by 566
  14. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  15. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  16. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
  17. 2022Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Modelscited by 382
  18. 2022Prompt-aligned Gradient for Prompt Tuningcited by 341
  19. 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 308
  20. 2020Learning to Learn Single Domain Generalizationcited by 296
  21. 2021A Fourier-based Framework for Domain Generalizationcited by 290
  22. 2020A Brief Review of Domain Adaptationcited by 288
  23. 2021Global Filter Networks for Image Classificationcited by 260
  24. 2020AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Promptscited by 249
  25. 2019Episodic Training for Domain Generalizationcited by 245
  26. 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
  27. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  28. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  29. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 181
  30. 2019Domain Generalization Using a Mixture of Multiple Latent Domainscited by 170
  31. 2021Learning to Diversify for Single Domain Generalizationcited by 170
  32. 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
  33. 2020Learning to Balance Specificity and Invariance for In and Out of Domain Generalizationcited by 128
  34. 2020Maximum-Entropy Adversarial Data Augmentation for Improved Generalization and Robustnesscited by 121
  35. 2021Progressive Domain Expansion Network for Single Domain Generalizationcited by 97
  36. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  37. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  38. 2021Recent Advances in Domain Adaptation for the Classification of Remote Sensing Datacited by 70

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Few-Shot Remote Sensing Image Scene Classification with CLIP and Prompt Learning
  2. 2026bi-modal textual prompt learning for vision-language models in remote sensing
  3. 2024In the Era of Prompt Learning with Vision-Language Models
  4. 2025Frequency-Aware Vision-Language Multimodality Generalization Network for Remote Sensing Image Classification
  5. 2024Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment
  6. 2025Few-Shot Adaptation Benchmark for Remote Sensing Vision-Language Models
  7. 2026Beyond Templates: Revisiting Zero-Shot Remote Sensing through Meta-Prompting
  8. 2025RSRWKV: A Linear-Complexity 2D Attention Mechanism for Efficient Remote Sensing Vision Task