Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result
Not on the map. Why?
Abstract (arXiv)
Personalizing a frozen large language model (LLM) to individual users is often framed as a meta-learning problem in prompt space: each user is a task, and one seeks a shared natural-language adaptation policy that, given a handful of the user's labeled interactions, configures the frozen model for that user. The framing is attractive because it is backbone-agnostic and reuses the machinery of prompt optimization, yet the field rarely tests whether the optimized meta-objective encodes transferable cross-user adaptation rather than generic instruction quality. We study this question with Muse (Meta-learned User-adaptation via Shared Evolution), which evolves a single shared adaptation prompt over a meta-train user population by reflective prompt evolution, freezes it, and applies it zero-shot to held-out users; matched controls isolate learning from confounds of phrasing and selection. On two standard personalization benchmarks (LaMP-2 categorization and LaMP-3 rating) over 200 held-out users each, Muse does not significantly improve on its own un-evolved seed prompt or on a structure-broken control that meta-trains on mismatched user-support pairs, and is dominated by plain few-shot retrieval on the rating task (Delta MAE +0.175, p < 0.001). We attribute these outcomes to a single mechanism, meta-objective collapse: the meta-validation objective is statistically invariant to whether the user-support correspondence is genuine (p=0.555 on LaMP-2, p=0.622 on LaMP-3), so it cannot be optimized into transferable adaptation and instead rewards instruction polish and validation overfitting. The seed-prompt, wrong-support, and invariance-oracle controls form a reusable protocol that separates learned adaptation from these confounds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 79 of its 88 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
79 of 88 references.
References · 79
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
38 more
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025s1: Simple test-time scalingcited by 1,341
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Large Language Models as Optimizerscited by 864
- 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2022Transformers learn in-context by gradient descentcited by 732
- 2023In-Context Retrieval-Augmented Language Modelscited by 702
- 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 684
- 2024Self-Rewarding Language Modelscited by 681
- 2022Large Language Models Can Self-Improvecited by 664
- 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
- 2021Fast Model Editing at Scalecited by 498
- 2021MetaICL: Learning to Learn In Contextcited by 454
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
- 2024Agent Workflow Memorycited by 383
- 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 379
- 2023A Survey on Large Language Models for Recommendationcited by 379
50 most cited of 79 All 79 (JSON)
Built on by
Not cited yet.