mlsanityData to 14 Oct 2026

PromptHub: Enhancing Multi-Prompt Visual In-Context Learning with Locality-Aware Fusion, Concentration and Alignment

arXiv 2603.18891 ↗First posted 19 Mar 2026cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Visual In-Context Learning (VICL) aims to complete vision tasks by imitating pixel demonstrations. Recent work pioneered prompt fusion that combines the advantages of various demonstrations, which shows a promising way to extend VICL. Unfortunately, the patch-wise fusion framework and model-agnostic supervision hinder the exploitation of informative cues, thereby limiting performance gains. To overcome this deficiency, we introduce PromptHub, a framework that holistically strengthens multi-prompting through locality-aware fusion, concentration and alignment. PromptHub exploits spatial priors to capture richer contextual information, employs complementary concentration, alignment, and prediction objectives to mutually guide training, and incorporates data augmentation to further reinforce supervision. Extensive experiments on three fundamental vision tasks demonstrate the superiority of PromptHub. Moreover, we validate its universality, transferability, and robustness across out-of-distribution settings, and various retrieval scenarios. This work establishes a reliable locality-aware paradigm for prompt fusion, moving beyond prior patch-wise approaches. Code is available at https://github.com/luotc-why/ICLR26-PromptHub.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 45 of its 53 references that are in the map. First posted on arXiv 19 Mar 2026.

Builds on

45 of 53 references.

References · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  8. 2022Emergent Abilities of Large Language Modelscited by 2,512
  9. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  10. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  11. 2022Transformers learn in-context by gradient descentcited by 732
  12. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
33 more
  1. 2020AdapterHub: A Framework for Adapting Transformerscited by 444
  2. 2023Larger language models do in-context learning differentlycited by 394
  3. 2017One-Shot Learning for Semantic Segmentationcited by 337
  4. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
  5. 2023In-Context Learning Creates Task Vectorscited by 312
  6. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
  7. 2022Exploring Visual Prompts for Adapting Large-Scale Modelscited by 274
  8. 2022Visual Prompting via Image Inpaintingcited by 250
  9. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  10. 2023SegGPT: Segmenting Everything In Contextcited by 194
  11. 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
  12. 2022Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrationscited by 116
  13. 2023In-Context Learning Unlocked for Diffusion Modelscited by 104
  14. 2022On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Modelcited by 81
  15. 2023Exploring Diverse In-Context Configurations for Image Captioningcited by 63
  16. 2023Exploring Effective Factors for Improving Visual In-Context Learningcited by 43
  17. 2023Explore In-Context Learning for 3D Point Cloud Understandingcited by 40
  18. 2023Instruct Me More! Random Prompting for Visual In-Context Learningcited by 30
  19. 2024Finding Visual Task Vectorscited by 24
  20. 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulationcited by 16
  21. 2024Towards Global Optimal Visual In-Context Learning Prompt Selectioncited by 15
  22. 2025Personalized Vision via Visual In-Context Learningcited by 14
  23. 2024DG-PIC: Domain Generalized Point-In-Context Learning for Point Cloud Understandingcited by 13
  24. 2025Refining CLIP's Spatial Awareness: A Visual-Centric Perspectivecited by 13
  25. 2025Dynamic Multimodal Prototype Learning in Vision-Language Modelscited by 13
  26. 2023Patch-Prompt Aligned Bayesian Prompt Tuning for Vision-Language Modelscited by 12
  27. 2025Stable Diffusion Models are Secretly Good at Visual In-Context Learningcited by 8
  28. 2025Learning to Pose Problems: Reasoning-Driven and Solver-Adaptive Data Synthesiscited by 8
  29. 2025Embracing Collaboration Over Competition: Condensing Multiple Prompts for Visual In-Context Learningcited by 7
  30. 2024TsCA: On the Semantic Consistency Alignment via Conditional Transport for Compositional Zero-Shot Learningcited by 6
  31. 2025OmniAlpha: Aligning Transparency-Aware Generation via Multi-Task Unified Reinforcement Learningcited by 3
  32. 2025PANICL: Mitigating Over-Reliance on Single Prompt in Visual In-Context Learningcited by 1
  33. 2026Enhancing Geometric Perception in VLMs via Translator-Guided Reinforcement Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.