Knowing When Not to Reuse: Conditional Experience Transfer in Autonomous LLM Post-Training
Not on the map. Why?
Abstract (arXiv)
Large language models offer broad capabilities, but adapting them to evolving domains, tools, and requirements often entails repeated post-training. Autonomous systems automate parts of this process by proposing updates, training candidates, and using evaluation feedback to select subsequent proposals. As evidence accumulates, a central problem emerges: which past update evidence remains actionable after subsequent training has changed the parent model? An update's effect depends on its parent, data, and training stage. Treating past success as context-free permission can waste compute. If the resulting child is promoted, it can also degrade the subsequent training trajectory. We formulate this problem as conditional experience transfer and introduce Boundary-Calibrated Intervention Transfer (BCIT), a method that authorizes experience reuse before weight-changing training. BCIT binds an observed effect to its source context, checks applicability conditions, vetoes candidates with named hard conflicts, and obtains current-state evidence through a bounded training trial when needed. Fully trained candidates still face a shared adoption rule, and only observed events extend memory. On one 4B model adapted across finance reasoning, text-to-SQL, and function calling, candidate updates exhibit heterogeneous target and retention effects across the evaluated contexts. Under matched candidates, evidence, and compute, BCIT authorizes fewer harmful updates and attains higher equal-budget final-model quality than the evaluated alternatives. These results support treating experience authorization as a distinct problem in autonomous post-training.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
16 of 25 references.
References · 16
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 688
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2018Characterizing and Avoiding Negative Transfercited by 226
- 2018A System for Massively Parallel Hyperparameter Tuningcited by 201
- 2021LogME: Practical Assessment of Pre-trained Models for Transfer Learningcited by 168
4 more
- 2026EvoTrainer: Co-Evolving LLM Policies and Training Harnesses for Autonomous Agentic Reinforcement Learningcited by 9
- 2025LaMDAgent: An Autonomous Framework for Post-Training Pipeline Optimization via LLM Agentscited by 6
- 2026TREX: Automating LLM Fine-tuning via Agent-Driven Tree-based Explorationcited by 6
- 2026Automatic Configuration of LLM Post-Training Pipelinescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learn Now, Use Next, Trust Later: Prequential Test-Time Learning for LLM Agents
- 2026Rethinking Continual Experience Internalization for Self-Evolving LLM Agents
- 2026Knowledge is Not Enough: Injecting RL Skills for Continual Adaptation
- 2026CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
- 2026Self-Improving Large Language Models via Progressive Experience Evolution
- 2025Evolving LLMs' Self-Refinement Capability via Synergistic Training-Inference Optimization
- 2026LifeMem: Enabling Lifelong Experience Reuse for LLM Agents
- 2026Large Language Model Post-Training: A Unified View of Off-Policy and On-Policy Learning