mlsanityData to 7 Oct 2026

Rewind-IL: Online Failure Detection and State Respawning for Imitation Learning

arXiv 2604.16683 ↗First posted 17 Apr 2026cs.RO cs.AI cs.CVcited by 7

On the map: Offline RL and imitation learning from data → Language-conditioned policies and VLAs

Abstract (arXiv)

Imitation learning has enabled robots to acquire complex visuomotor manipulation skills from demonstrations, but deployment failures remain a major obstacle, especially for long-horizon action-chunked policies. Once execution drifts off the demonstration manifold, these policies often continue producing locally plausible actions without recovering from the failure. Existing runtime monitors either require failure data, over-trigger under benign feature drift, or stop at failure detection without providing a recovery mechanism. We present Rewind-IL, a training-free online safeguard framework for generative action-chunked imitation policies. Rewind-IL combines a zero-shot failure detector based on Temporal Inter-chunk Discrepancy Estimate (TIDE), calibrated with split conformal prediction, with a state-respawning mechanism that returns the robot to a semantically verified safe intermediate state. Offline, a vision-language model identifies recovery checkpoints in demonstrations, and the frozen policy encoder is used to construct a compact checkpoint feature database. Online, Rewind-IL monitors self-consistency in overlapping action chunks, tracks similarity to the checkpoint library, and, upon failure, rewinds execution to the latest verified safe state before restarting inference from a clean policy state. Experiments on real-world and simulated long-horizon manipulation tasks, including transfer to flow-matching action-chunked policies, demonstrate that policy-internal consistency coupled with semantically grounded respawning offers a practical route to improved reliability in imitation learning. Supplemental materials are available at https://sjay05.github.io/rewind-il

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Language-conditioned policies and VLAs, one of 13 directions in Offline RL and imitation learning from data. Builds on 22 of its 34 references that are in the map. First posted on arXiv 17 Apr 2026.

Builds on

22 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025InFeR: Informed Failure Resilience in Learned Visual Navigation Control28 Oct
  2. 2025Failure Prediction at Runtime for Generative Robot Policies10 Oct
  3. 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policies11 Mar
  4. 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress6 Oct

Other references · 18

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  5. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  6. 2019Control Barrier Functions: Theory and Applicationscited by 332
  7. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
  8. 2025From Foresight to Forethought: VLM-In-the-Loop Policy Steering via Latent Alignmentcited by 51
  9. 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignmentcited by 15
  10. 2026CycleVLA: Proactive Self-Correcting Vision-Language-Action Models via Subtask Backtracking and Minimum Bayes Risk Decodingcited by 13
  11. 2025MoE-DP: An MoE-Enhanced Diffusion Policy for Robust Long-Horizon Robotic Manipulation with Skill Decomposition and Failure Recoverycited by 9
  12. 2025Uncertainty Comes for Free: Human-in-the-Loop Policies with Diffusion Modelscited by 6
6 more
  1. 2026TriPilot-FF: Coordinated Whole-Body Teleoperation with Force Feedbackcited by 5
  2. 2025DOSE3 : Diffusion-based Out-of-distribution detection on SE(3) trajectoriescited by 3
  3. 2025KDPE: A Kernel Density Estimation Strategy for Diffusion Policy Trajectory Selectioncited by 3
  4. 2025FTACT: Force Torque aware Action Chunking Transformer for Pick-and-Reorient Bottle Taskcited by 3
  5. 2025EVE: A Generator-Verifier System for Generative Policiescited by 2
  6. 2025Reliable Robotic Task Execution in the Face of Anomaliescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies
  2. 2026FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement
  3. 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filtering
  4. 2025RESample: A Robust Data Augmentation Framework via Exploratory Sampling for Robotic Manipulation
  5. 2026It's Not Just More Demos: Counterfactual Action Sensitivity Coverage for Data-Efficient Robust Robot Imitation
  6. 2025RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correction
  7. 2026Beyond Monotonic Progress: Retry-Supervised Value Learning for Robot Imitation
  8. 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learning