PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning
Not on the map. Why?
Abstract (arXiv)
In-context learning (ICL) has attracted increasing attention for enabling models to perform new tasks using only a few ``input--output'' prompt examples. However, existing approaches suffer from shallow task adaptation, where prompts are primarily used as contextual cues to implicitly infer task intent through semantic representations, while the underlying computational process remains unchanged. This limitation restricts task-specific adaptation and compromises inference interpretability. We argue that prompts should not only condition feature representations but also dynamically regulate the model's computation pathways. To this end, we propose PromptPath, an adaptive ICL framework that enables computation-level adaptation through prompt-conditioned dynamic pathways. Specifically, PromptPath introduces a prompt-driven routing mechanism to selectively activate and compose lightweight low-rank experts, forming task-specific computational pathways tailored to different prompts. By integrating prompt information directly into the inference process, PromptPath dynamically reconfigures model computation to enhance task specialization and interpretability. Extensive experiments on 3D point cloud and 2D visual recognition benchmarks demonstrate that PromptPath consistently outperforms state-of-the-art ICL baselines while exhibiting strong cross-domain and cross-task generalization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 51 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
47 of 51 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
35 more
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2021Scaling Vision with Sparse Mixture of Expertscited by 740
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 641
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
- 2022Mixture-of-Experts with Expert Choice Routingcited by 611
- 2021MetaICL: Learning to Learn In Contextcited by 450
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 307
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
- 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
- 2022Visual Prompting via Image Inpaintingcited by 248
- 2023From Sparse to Soft Mixtures of Expertscited by 245
- 2023What Makes Good Examples for Visual In-Context Learning?cited by 150
- 2023Unified Demonstration Retriever for In-Context Learningcited by 141
- 2022Diverse Demonstrations Improve In-context Compositional Generalizationcited by 136
- 2024Visual In-Context Learning for Large Vision-Language Modelscited by 124
- 2021Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inferencecited by 96
- 2023LoRAMoE: Alleviate World Knowledge Forgetting in Large Language Models via MoE-Style Plugincited by 82
- 2023Exploring Effective Factors for Improving Visual In-Context Learningcited by 43
- 2023When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitationscited by 41
- 2023Explore In-Context Learning for 3D Point Cloud Understandingcited by 40
- 2023Instruct Me More! Random Prompting for Visual In-Context Learningcited by 30
- 2025Lifting the Veil on Visual Information Flow in MLLMs: Unlocking Pathways to Faster Inferencecited by 23
- 2024Routers in Vision Mixture of Experts: An Empirical Studycited by 22
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
- 2022Cross-Lingual Retrieval Augmented Prompt for Low-Resource Languagescited by 17
- 2024Parameter-efficient Prompt Learning for 3D Point Cloud Understandingcited by 16
- 2024Towards Global Optimal Visual In-Context Learning Prompt Selectioncited by 15
- 2025Embracing Collaboration Over Competition: Condensing Multiple Prompts for Visual In-Context Learningcited by 7
- 2024MICAS: Multi-grained In-Context Adaptive Sampling for 3D Point Cloud Processingcited by 5
- 2024Point-In-Context: Understanding Point Cloud via In-Context Learningcited by 4
- 2025Point-MoE: Large-Scale Multi-Dataset Training with Mixture-of-Experts for 3D Semantic Segmentationcited by 3
- 2025E-InMeMo: Enhanced Prompting for Visual In-Context Learningcited by 1
Built on by
Not cited yet.