When Validation Stops Learning: Auditing Update Admission for Continual Embodied Agents
Not on the map. Why?
Abstract (arXiv)
Independent evaluation can reject harmful policy updates yet also prevent useful continual learning. We argue that update admission must be assessed through both error control and retained learning opportunities at a stated interaction budget. We identify a concrete failure: a range-based confidence gate cannot certify unchanged old-task behavior within otherwise substantial budgets. A standard paired-binomial construction reduces this burden when outcome disagreements are rare. We also specify certified historical-reference promotion and a round-level missed-opportunity metric. In a constructed one-step pushing diagnostic with 32 seeds, fresh paired checks admit 31.6% of a common update stream at 2,000 episodes per stage, versus zero for the range-based gate; unconditional replay nevertheless learns better in closed-loop runs. A separate learned-dynamics stress test distinguishes model bias from feedback-selection error. The contribution is an admission-audit protocol with analytical and synthetic evidence; physical-robot and VLA validation remain open.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 12 references that are in the map. First posted on arXiv 9 Sep 2026.
Builds on
7 of 12 references.
References · 7
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2018Experience Replay for Continual Learningcited by 1,074
- 2017Selective Classification for Deep Neural Networkscited by 799
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2025WorldEval: World Model as Real-World Robot Policies Evaluatorcited by 64
- 2020Towards Safe Policy Improvement for Non-Stationary MDPscited by 26
- 2026Imperfect World Models are Exploitablecited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Self-Evolving Agent Skills: Feedback Dynamics over Multiple Rounds
- 2025Assessing Policy Updates: Toward Trust-Preserving Intelligent User Interfaces
- 2026EVISKILL: Grounding Skill Evolution in Replayable Evidence
- 2026Causal Retention in Interactive Agents: Interface Factorization and Selective Adaptation
- 2026Seeing Isn't Believing: Mitigating Belief Inertia via Active Intervention in Embodied Agents
- 2026VeriFine: Scaling Verification for Self-Improvement in Embodied Reasoning
- 2026EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution
- 2026When Better Gets Worse: Improvement Fidelity for Self-Improving Agents in Adaptive Worlds