Completion at the Boundary (CaB): Deployable Switching with Completion-Aware Control under Limited Calibration
Not on the map. Why?
Abstract (arXiv)
Vision-language-action (VLA) agents can execute natural-language instructions, yet deployed systems still lack an operational interface: deciding when the instruction is complete. This gap is acute in short composites ("do A, then B"), where mistimed handoffs cascade into downstream failures. Completion is inherently closed-loop because switching is an intervention that changes the instruction context and thus future actions and observations. We study completion under a deployable low-calibration regime motivated by open-ended instruction spaces, enforcing no test-time relearning and a single globally calibrated switching rule selected once on development set and reused unchanged on test set. Under this constraint, collapsing asymmetric boundary evidence into a single scalar can be brittle under polarity shifts across tasks. We propose Completion at the Boundary (CaB), which predicts an event-local completion object in the form of Boundary-Phase Tokens (Before/Hit/After), retaining two-sided boundary evidence under this discipline. CaB-When converts this completion object into a minimal, auditable switching decision (when), while CaB-How reuses the same completion object to condition action generation for boundary-stable control through handoffs (how). Using an intervention-aware E1/E2 protocol, we show that CaB improves composite execution and handoff quality on a first-person Minecraft VLA benchmark under matched capacity and deployability constraints.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
40 of 49 references.
References · 40
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 478
- 2016The Option-Critic Architecturecited by 448
28 more
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 345
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2018Visual Reinforcement Learning with Imagined Goalscited by 251
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2019MineRL: A Large-Scale Dataset of Minecraft Demonstrationscited by 215
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
- 2019Self-Monitoring Navigation Agent via Auxiliary Progress Estimationcited by 176
- 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 168
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2023Vision-Language Models as Success Detectorscited by 142
- 2023STEVE-1: A Generative Model for Text-to-Behavior in Minecraftcited by 97
- 2024Vision Language Models are In-Context Value Learnerscited by 90
- 2018Temporal Difference Models: Model-Free Deep RL for Model-Based Controlcited by 89
- 2025SAFE: Multitask Failure Detection for Vision-Language-Action Modelscited by 80
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learningcited by 71
- 2024APOLLO: SGD-like Memory, AdamW-level Performancecited by 54
- 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulationcited by 45
- 2025Self-Improving Embodied Foundation Modelscited by 32
- 2024OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agentscited by 30
- 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agentscited by 30
- 2025JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mousecited by 28
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
- 2026PALM: Progress-Aware Policy Learning via Affordance Reasoning for Long-Horizon Robotic Manipulationcited by 21
- 2024PROGRESSOR: A Perceptually Guided Reward Estimator with Self-Supervised Online Refinementcited by 13
- 2024MineStudio: A Streamlined Package for Minecraft AI Agent Developmentcited by 13
- 2025OpenHA: A Series of Open-Source Hierarchical Agentic Models in Minecraftcited by 10
- 2025MineAnyBuild: Benchmarking Spatial Planning for Open-world AI Agentscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies
- 2026Long-Horizon Manipulation via Trace-Conditioned VLA Planning
- 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models
- 2026RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
- 2026StreamVLA: Breaking the Reason-Act Cycle via Completion-State Gating
- 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
- 2026Interlock: From Local Correctness to Task Completion in Long-Horizon Agents
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Model