mlsanityData to 14 Oct 2026

Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibration

arXiv 2606.00145 ↗First posted 29 May 2026cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Vision-language-action (VLA) agents can execute natural-language instructions, yet deployed systems still lack an operational interface: deciding when the instruction is complete. This gap is acute in short composites ("do A, then B"), where mistimed handoffs cascade into downstream failures. Completion is inherently closed-loop because switching is an intervention that changes the instruction context and thus future actions and observations. We study completion under a deployable low-calibration regime motivated by open-ended instruction spaces, enforcing no test-time relearning and a single globally calibrated switching rule selected once on development set and reused unchanged on test set. Under this constraint, collapsing asymmetric boundary evidence into a single scalar can be brittle under polarity shifts across tasks. We propose Completion at the Boundary (CaB), which predicts an event-local completion object in the form of Boundary-Phase Tokens (Before/Hit/After), retaining two-sided boundary evidence under this discipline. CaB-When converts this completion object into a minimal, auditable switching decision (when), while CaB-How reuses the same completion object to condition action generation for boundary-stable control through handoffs (how). Using an intervention-aware E1/E2 protocol, we show that CaB improves composite execution and handoff quality on a first-person Minecraft VLA benchmark under matched capacity and deployability constraints.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

40 of 49 references.

References · 40

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  4. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  8. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
  9. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  10. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  11. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
  12. 2016The Option-Critic Architecturecited by 448
28 more
  1. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
  2. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  3. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  4. 2018Visual Reinforcement Learning with Imagined Goalscited by 251
  5. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  6. 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 215
  7. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
  8. 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
  9. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
  10. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  11. 2023Vision-Language Models as Success Detectorscited by 142
  12. 2023STEVE-1: A Generative Model for Text-to-Behavior in Minecraftcited by 97
  13. 2024Vision Language Models are In-Context Value Learnerscited by 90
  14. 2018Temporal Difference Models: Model-Free Deep RL for Model-Based Controlcited by 89
  15. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Modelscited by 80
  16. 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learningcited by 71
  17. 2024APOLLO: SGD-like Memory, AdamW-level Performancecited by 54
  18. 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulationcited by 45
  19. 2025Self-Improving Embodied Foundation Modelscited by 32
  20. 2024OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agentscited by 30
  21. 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agentscited by 30
  22. 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 28
  23. 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
  24. 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulationcited by 21
  25. 2024PROGRESSOR: A Perceptually Guided Reward Estimator with Self-Supervised Online Refinementcited by 13
  26. 2024MineStudio: A Streamlined Package for Minecraft AI Agent Developmentcited by 13
  27. 2025OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraftcited by 10
  28. 2025MineAnyBuild: Benchmarking Spatial Planning for Open-world AI Agentscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies
  2. 2026Long-Horizon Manipulation via Trace-Conditioned VLA Planning
  3. 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models
  4. 2026RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
  5. 2026StreamVLA: Breaking the Reason-Act Cycle via Completion-State Gating
  6. 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
  7. 2026Interlock: From Local Correctness to Task Completion in Long-Horizon Agents
  8. 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Model