mlsanityData to 7 Oct 2026

Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models

arXiv 2605.11809 ↗First posted 12 May 2026cs.AIcited by 0

On the map: Vision-language-action models → World model-based VLA

Abstract (arXiv)

Vision-Language-Action (VLA) models have advanced rapidly with stronger backbones, broader pre-training, and larger demonstration datasets, yet their action heads remain largely homogeneous: most directly predict action commands in a fixed world coordinate frame. We propose MCF-Proto, a lightweight action head that equips VLA policies with a Motion-Centric Action Frame (MCF) and a prototype-based action parameterization. At each step, the policy predicts a rotation Rt ∈ SO(3), composes actions in the transformed local frame from a set of prototypes, and maps them back to the world frame for end-to-end training, using only standard demonstrations without auxiliary supervision. This simple design induces stable emergent structure. Without explicit directional labels, the learned local frames develop a stable geometric structure whose axes are strongly compatible with demonstrated end-effector motion. Meanwhile, actions in the learned representation become substantially more compact, with variation captured by fewer dominant directions and more regularly organized by shared prototypes. These structural properties translate into improved robustness, especially under geometric perturbations. Our results suggest that adding lightweight geometric and compositional structure to the action head can materially improve how VLA policies organize and generalize robotic manipulation behavior. An anonymized code repository is provided in the supplementary material.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World model-based VLA, one of 13 directions in Vision-language-action models. Builds on 40 of its 52 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

40 of 52 references.

References · 40

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  6. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  11. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  12. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
28 more
  1. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
  2. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
  3. 2021Implicit Behavioral Cloningcited by 442
  4. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  5. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  6. 2022Behavior Transformers: Cloning k modes with one stonecited by 299
  7. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
  8. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  9. 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
  10. 2024Behavior Generation with Latent Actionscited by 159
  11. 2023Distilled Feature Fields Enable Few-Shot Language-Guided Manipulationcited by 130
  12. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
  13. 2025Unified Vision-Language-Action Modelcited by 128
  14. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
  15. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  16. 2022From Play to Policy: Conditional Behavior Generation from Uncurated Robot Datacited by 103
  17. 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 60
  18. 2023PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulationcited by 56
  19. 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 54
  20. 2022SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fieldscited by 51
  21. 2017Deep Object-Centric Representations for Generalizable Robot Learningcited by 50
  22. 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 25
  23. 2022PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Trainingcited by 24
  24. 2024Deep SE(3)-Equivariant Geometric Reasoning for Precise Placement Taskscited by 19
  25. 2020Learning to Compose Hierarchical Object-Centric Controllers for Robotic Manipulationcited by 17
  26. 2021Constrained Probabilistic Movement Primitives for Robot Trajectory Adaptationcited by 7
  27. 2020Manipulation-Oriented Object Perception in Clutter through Affordance Coordinate Framescited by 4
  28. 2023Deep Probabilistic Movement Primitives with a Bayesian Aggregatorcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PAIR: Bridging Perception and Action in Vision-Language-Action Models
  2. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  3. 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
  4. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  5. 2026World Pilot: Steering Vision-Language-Action Models with World-Action Priors
  6. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
  7. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model
  8. 2026RotVLA: Rotational Latent Action for Vision-Language-Action Model