mlsanityData to 14 Oct 2026

Prompt-Space Meta-Learning Does Not Transfer Across Users: A Frozen-LLM Negative Result

arXiv 2609.01615 ↗First posted 25 Jun 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Personalizing a frozen large language model (LLM) to individual users is often framed as a meta-learning problem in prompt space: each user is a task, and one seeks a shared natural-language adaptation policy that, given a handful of the user's labeled interactions, configures the frozen model for that user. The framing is attractive because it is backbone-agnostic and reuses the machinery of prompt optimization, yet the field rarely tests whether the optimized meta-objective encodes transferable cross-user adaptation rather than generic instruction quality. We study this question with Muse (Meta-learned User-adaptation via Shared Evolution), which evolves a single shared adaptation prompt over a meta-train user population by reflective prompt evolution, freezes it, and applies it zero-shot to held-out users; matched controls isolate learning from confounds of phrasing and selection. On two standard personalization benchmarks (LaMP-2 categorization and LaMP-3 rating) over 200 held-out users each, Muse does not significantly improve on its own un-evolved seed prompt or on a structure-broken control that meta-trains on mismatched user-support pairs, and is dominated by plain few-shot retrieval on the rating task (Delta MAE +0.175, p < 0.001). We attribute these outcomes to a single mechanism, meta-objective collapse: the meta-validation objective is statistically invariant to whether the user-support correspondence is genuine (p=0.555 on LaMP-2, p=0.622 on LaMP-3), so it cannot be optimized into transferable adaptation and instead rewards instruction polish and validation overfitting. The seed-prompt, wrong-support, and invariance-oracle controls form a reusable protocol that separates learned adaptation from these confounds.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 79 of its 88 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

79 of 88 references.

References · 79

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  10. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  11. 2016Matching Networks for One Shot Learningcited by 2,255
  12. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
38 more
  1. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  2. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  3. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  4. 2025s1: Simple test-time scalingcited by 1,341
  5. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  6. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  8. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  9. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,195
  10. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  11. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  12. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  13. 2020Meta-Learning in Neural Networks: A Surveycited by 950
  14. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
  15. 2023Large Language Models as Optimizerscited by 864
  16. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 849
  17. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
  18. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  19. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
  20. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  21. 2022Transformers learn in-context by gradient descentcited by 732
  22. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  23. 2022What learning algorithm is in-context learning? Investigations with linear modelscited by 684
  24. 2024Self-Rewarding Language Modelscited by 681
  25. 2022Large Language Models Can Self-Improvecited by 664
  26. 2021Learning To Retrieve Prompts for In-Context Learningcited by 648
  27. 2016Learning to learn by gradient descent by gradient descentcited by 620
  28. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 556
  29. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 551
  30. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 542
  31. 2021Fast Model Editing at Scalecited by 498
  32. 2021MetaICL: Learning to Learn In Contextcited by 454
  33. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  34. 2018TADAM: Task dependent adaptive metric for improved few-shot learningcited by 408
  35. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 398
  36. 2024Agent Workflow Memorycited by 383
  37. 2017Meta-SGD: Learning to Learn Quickly for Few-Shot Learningcited by 379
  38. 2023A Survey on Large Language Models for Recommendationcited by 379

50 most cited of 79 All 79 (JSON)

Built on by

Not cited yet.