FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models
On the map: Vision-language-action models → World model-based VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models have achieved impressive results in visuomotor policy learning, yet remain fundamentally reactive, mapping current observations and language to actions without explicit forward prediction of world dynamics. Existing visual foresight methods predict future visual states but lack explicit motion guidance: they show where to go but not how to get there. We argue that future feature prediction and sparse point tracking are naturally complementary: the former provides the goal state, while the latter captures the continuous motion path toward it. We propose FoMoVLA, a framework that augments VLA representations with explicit spatio-temporal supervision by jointly learning future feature foresight and sparse 2D point tracking, enhancing the continuous action policy. FoMoVLA introduces compact foresight tokens to decode future feature states, decodes sparse temporal 2D point trajectories to model compact geometric motion, and couples both through a lightweight future-conditioned cross-attention module that enables consistent reasoning between anticipated states and point dynamics. Extensive experiments on LIBERO, RoboCasa GR-1 Tabletop, and LIBERO-Plus demonstrate state-of-the-art performance and strong zero-shot generalization. Project page is available at https://liauto-research.github.io/FoMoVLA.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World model-based VLA, one of 13 directions in Vision-language-action models. Builds on 35 of its 36 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
35 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation1 Jun
- 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
- 2025Unifying Perception and Action: A Hybrid-Modality Pipeline with Implicit Visual Chain-of-Thought for Robotic Action Generation25 Nov
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge6 Jul
Other references · 30
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
18 more
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 48
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 46
- 2026BagelVLA: Enhancing Long-Horizon Manipulation via Interleaved Vision-Language-Action Generationcited by 25
- 2026LangForce: Bayesian Decomposition of Vision Language Action Models via Latent Action Queriescited by 24
- 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
- 2026Point Tracking Improves World Action Modelscited by 7
- 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulationcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actions
- 2026ForeAct: Steering Your VLA with Efficient Visual Foresight Planning
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Model
- 2026MotionWeave: Learning Motion-Centered Future Dynamics for Vision-Language-Action Policies
- 2026Anticipate Before Acting: Future-State-Conditioned Vision-Language Navigation
- 2026Beyond Dense Futures: World Models as Structured Planners for Robotic Manipulation
- 2025HiF-VLA: Hindsight, Insight and Foresight through Motion Representation for Vision-Language-Action Models
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model