Learning What to Keep: Transfer-Aware Personal Skill Learning from User Feedback
Not on the map. Why?
Abstract (arXiv)
User feedback enables LLMs to refine reusable personalized skills, but often mixes persistent preferences with request-specific corrections. Indiscriminately retaining both risks negative transfer, motivating selective retention at the level of individual requirements. We frame this challenge as selective transfer over atomic rules and propose SkillGrain, a framework for learning reusable personalized skills from user feedback. SkillGrain decomposes feedback into independently actionable rules, predicts their transferability, and retains only those suitable for future requests. To learn these decisions, we combine rubric-guided skill rewards with fine-grained credit assignment that separately evaluates rule content and retention decisions. We further jointly optimize skill induction and skill-conditioned generation through reinforcement learning, ensuring that learned skills support downstream personalization. We construct a benchmark spanning five personalized writing tasks to evaluate cross-request generalization. Experiments across three base models in both in-domain and out-of-domain settings show that SkillGrain achieves the best overall average performance among competing methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
19 of 30 references.
References · 19
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2026AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolutioncited by 115
- 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 97
- 2024LLMs + Persona-Plug = Personalized LLMscited by 32
- 2026MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluationcited by 27
- 2025Preference-Aware Memory Update for Long-Term LLM Agentscited by 20
- 2024RLVF: Learning from Verbal Feedback without Overgeneralizationcited by 19
- 2025Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personascited by 19
- 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 18
7 more
- 2025PersonaAgent: Bridging Memory and Action for Personalized LLM Agentscited by 14
- 2026WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolutioncited by 12
- 2025CoPL: Collaborative Preference Learning for Personalizing LLMscited by 10
- 2026Getting Better at Working With You: Compiling User Corrections into Runtime Enforcement for Coding Agentscited by 5
- 2026From Memory to Skills: Evidence-Grounded Co-Evolution Governance for Long-Horizon LLM Agentscited by 5
- 2026SkillCommit: Evolving Agent Skills through Behaviorally Validated Scope Expansioncited by 5
- 2026Text as a Universal Interface for Transferable Personalizationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward
- 2025Towards Faithful and Controllable Personalization via Critique-Post-Edit Reinforcement Learning
- 2024Personalized Adaptation via In-Context Preference Learning
- 2026Different Feedback, Different Updates: Selective Self-Learning from User Interactions for Large Language Models
- 2026One Adapts to Any: Meta Reward Modeling for Personalized LLM Alignment
- 2026COPE: Continual Personalization of LLMs under Sparse User Feedback via User Embeddings and Self-Evaluation
- 2025Reflective Personalization Optimization: A Post-hoc Rewriting Framework for Black-Box Large Language Models
- 2026Using Context Is Not Enough: Test-Time Training for Personalized Reward Modeling