Beyond Actions: Learning Future Operation Targets for Vision-Language-Action Models
On the map: Vision-language-action models → Human-video and latent-action pretraining also fits: World model-based VLA
Abstract (arXiv)
Actions specify what a robot should execute, but do not describe what those commands will achieve. Vision-language-action (VLA) policies nevertheless learn primarily by predicting action chunks from images, language, and state. We introduce Action--Future Coupled Effect Learning (AFCE), which makes a future-grounded physical Effect the policy's primary prediction target. An offline tokenizer constructs temporally ordered Effect tokens from demonstrated actions, realized robot responses, and sparse visual transitions. Reconstruction objectives encourage the representation to retain executable detail and observed physical change. A flow-matching VLA predicts Effects from current images, instruction, and robot state, while a state-conditioned decoder converts them into action chunks. Embodiment-specific interfaces allow single- and dual-arm tasks to share the Effect model. On DexJoCo, AFCE achieves 50.97% overall success, improving over π0.5 and UVT by 11.82 and 15.21 percentage points, respectively. It leads on all five bimanual tasks, highlighting the value of Effect supervision for coordinated dexterous manipulation. The project page is available at https://afceproject.github.io/AFCE-Web/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Human-video and latent-action pretraining, one of 13 directions in Vision-language-action models. Builds on 21 of its 21 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
21 of 21 references.
Closest ancestors · 3
Same direction, newest first
- 2026Joint-Aligned Latent Action: Towards Scalable VLA Pretraining in the Wild25 Feb
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actions9 May
- 2024Latent Action Pretraining from Videos15 Oct
Other references · 18
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2026World Action Models are Zero-shot Policiescited by 465
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
6 more
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 75
- 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Modelscited by 63
- 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 46
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 16
- 2026DexJoCo: A Benchmark and Toolkit for Task-Oriented Dexterous Manipulation on MuJoCocited by 8
- 2026Unified Visuomotor Targets: Supervising VLAs Beyond Physical Actionscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling
- 2026Evo-World: A Lightweight Vision-Language-Action Model with Future Motion Prediction via Optical-Flow Supervision
- 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
- 2026FRAM: Trajectory-Guided Visual Feature Selection for Compact Language-Conditioned Robot Manipulation
- 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
- 2026WAVE-0: Bridging VLA Policies and WAMs with Lightweight Latent Future Prediction
- 2026Bridge-WA: Predicting Where and How the World Changes for Robotic Action