Adapter Naturally Serves as Decoupler for Cross-Domain Few-Shot Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Cross-domain few-shot segmentation (CD-FSS) is proposed to pre-train the model on a source-domain dataset with sufficient samples, and then transfer the model to target-domain datasets where only a few samples are available for efficient fine-tuning. There are majorly two challenges in this task: (1) the domain gap and (2) fine-tuning with scarce data. To solve these challenges, we revisit the adapter-based methods, and discover an intriguing insight not explored in previous works: the adapter not only helps the fine-tuning of downstream tasks but also naturally serves as a domain information decoupler. Then, we delve into this finding for an interpretation, and find the model's inherent structure could lead to a natural decoupling of domain information. Building upon this insight, we propose the Domain Feature Navigator (DFN), which is a structure-based decoupler instead of loss-based ones like current works, to capture domain-specific information, thereby directing the model's attention towards domain-agnostic knowledge. Moreover, to prevent the potential excessive overfitting of DFN during the source-domain training, we further design the SAM-SVN method to constrain DFN from learning sample-specific knowledge. On target domains, we freeze the model and fine-tune the DFN to learn target-specific knowledge specific. Extensive experiments demonstrate that our method surpasses the state-of-the-art method in CD-FSS significantly by 2.69% and 4.68% MIoU in 1-shot and 5-shot scenarios, respectively.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 46 of its 60 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
46 of 60 references.
References · 46
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2023Segment Anythingcited by 8,234
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2019Similarity of Neural Network Representations Revisitedcited by 1,755
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
34 more
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)cited by 669
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 576
- 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 554
- 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
- 2017One-Shot Learning for Semantic Segmentationcited by 337
- 2017Few-Shot Learning with Graph Neural Networkscited by 324
- 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 323
- 2021Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworkscited by 284
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 277
- 2020Prior Guided Feature Enrichment Network for Few-Shot Segmentationcited by 271
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 206
- 2021Hypercorrelation Squeeze for Few-Shot Segmentationcited by 193
- 2020Prototype Mixture Models for Few-shot Semantic Segmentationcited by 190
- 2018SG-One: Similarity Guidance Network for One-Shot Semantic Segmentationcited by 169
- 2019FSS-1000: A 1000-Class Dataset for Few-Shot Segmentationcited by 160
- 2020Few-Shot Segmentation Without Meta-Learning: A Good Transductive Inference Is All You Need?cited by 135
- 2022Self-Support Few-Shot Semantic Segmentationcited by 96
- 2022When Do Flat Minima Optimizers Work?cited by 78
- 2022Feature-Proxy Transformer for Few-Shot Segmentationcited by 58
- 2022Margin-Based Few-Shot Class-Incremental Learning with Class-Level Overfitting Mitigationcited by 45
- 2022Domain-invariant Feature Exploration for Domain Generalizationcited by 34
- 2024Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Miningcited by 30
- 2023Normalization Layers Are All That Sharpness-Aware Minimization Needscited by 27
- 2024Flatten Long-Range Loss Landscapes for Cross-Domain Few-Shot Learningcited by 26
- 2024APSeg: Auto-Prompt Network for Cross-Domain Few-Shot Semantic Segmentationcited by 26
- 2024Adapt Before Comparison: A New Perspective on Cross-Domain Few-Shot Segmentationcited by 22
- 2024Multimodality Helps Few-shot 3D Point Cloud Semantic Segmentationcited by 20
- 2024Rethinking Few-shot 3D Point Cloud Semantic Segmentationcited by 18
- 2024Compositional Few-Shot Class-Incremental Learningcited by 18
- 2023RestNet: Boosting Cross-Domain Few-Shot Segmentation with Residual Transformation Networkcited by 17
- 2024Lightweight Frequency Masker for Cross-Domain Few-Shot Semantic Segmentationcited by 17
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptationcited by 6
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentationcited by 1
- 2026Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matchingcited by 1
- 2025Inter- and Intra-image Refinement for Few Shot Segmentationcited by 0
- 2025Cross-Domain Few-Shot Segmentation via Ordinary Differential Equations over Time Intervalscited by 0
- 2026Selective, Regularized, and Calibrated: Harnessing Vision Foundation Models for Cross-Domain Few-Shot Semantic Segmentationcited by 0
- 2026Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentationcited by 0
- 2026Training-free Cross-domain Few-shot Segmentation via Robust Semantic Representation and Matching23 Jun 2026
- 2026Hierarchical Spatial and Channel Aggregation for Cross-domain Few-shot Segmentation23 Jun 2026
- 2026Selective, Regularized, and Calibrated: Harnessing Vision Foundation Models for Cross-Domain Few-Shot Semantic Segmentation19 May 2026
- 2026Make It Up: Fake Images, Real Gains in Generalized Few-shot Semantic Segmentation28 Mar 2026
- 2025Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation27 Oct 2025
- 2025Cross-Domain Few-Shot Segmentation via Ordinary Differential Equations over Time Intervals1 Sep 2025
- 2025Inter- and Intra-image Refinement for Few Shot Segmentation8 Jul 2025