Query-Conditioned Prototype Adaptation for Cross-Domain Few-Shot Learning: Single-Query Inference, Controlled Comparisons, and Failure Modes
Not on the map. Why?
Abstract (arXiv)
Cross-domain few-shot learning requires adapting a classifier to a new visual domain from very few labelled examples without target-time parameter updates. We isolate one question: under a fixed global representation, what does joint query-support adaptation contribute to prototype construction? The Within-Instance Prototypical Transformer (WIPT) implements single-query test-time prototype adaptation by jointly transforming one unlabelled query and the labelled support embeddings, then forming query-specific class means. Using a shared frozen ViT-S/16 encoder, miniImageNet source training, and CUB, EuroSAT and ISIC targets, we replicate the key comparisons across five independent training seeds. In 1-shot evaluation, WIPT improves frozen ProtoNet in every run on CUB (+0.21 percentage points) and EuroSAT (+2.07), but decreases ISIC (-0.22). In 5-shot evaluation, ProtoNet remains strongest overall, while WIPT consistently improves a capacity-matched support-only Transformer on ISIC (+0.99). Joint processing of up to five queries yields no reliable accuracy gain; in a head-only 5-shot benchmark, g = 5 reduces analytical attention-token pairs by 73% and peak allocated memory by 29% relative to g = 1, although latency is non-monotonic. Across all target/shot conditions, WIPT changes uncertain ProtoNet decisions far more than confident ones, and rescue/break decomposition accounts for the observed gains and losses. Source-shift and scorer controls further show that the benefit is not universal. Overall, WIPT provides a streaming-compatible form of test-time prototype adaptation that can improve difficult low-shot cross-domain decisions without target-time optimization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
13 of 20 references.
References · 13
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
- 2018Few-Shot Learning via Embedding Adaptation with Set-to-Set Functionscited by 293
- 2020Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformationcited by 183
- 2020CrossTransformers: spatially-aware few-shot transfercited by 174
- 2021Cross-domain Few-shot Learning with Task-specific Adapterscited by 79
- 2023StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learningcited by 53
- 2023Adaptive Parametric Prototype Learning for Cross-Domain Few-Shot Classificationcited by 4
- 2023PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classificationcited by 3
- 2021Hierarchical Representation based Query-Specific Prototypical Network for Few-Shot Image Classificationcited by 2
Built on by
Not cited yet.