Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models frequently encounter challenges in generalizing to real-world environments due to inherent discrepancies between observation and action spaces. Although training data are collected from diverse camera perspectives, the models typically predict end-effector poses within the robot base coordinate frame, resulting in spatial inconsistencies. To mitigate this limitation, we introduce the Observation-Centric VLA (OC-VLA) framework, which grounds action predictions directly in the camera observation space. Leveraging the camera's extrinsic calibration matrix, OC-VLA transforms end-effector poses from the robot base coordinate system into the camera coordinate system, thereby unifying prediction targets across heterogeneous viewpoints. This lightweight, plug-and-play strategy ensures robust alignment between perception and action, substantially improving model resilience to camera viewpoint variations. The proposed approach is readily compatible with existing VLA architectures, requiring no substantial modifications. Comprehensive evaluations on both simulated and real-world robotic manipulation tasks demonstrate that OC-VLA accelerates convergence, enhances task success rates, and improves cross-view generalization. The code will be publicly available.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 57 of its 61 references that are in the map. First posted on arXiv 18 Aug 2025.
Builds on
57 of 61 references.
Closest ancestors · 2
Same direction, newest first
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model27 Jan
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
Other references · 55
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
38 more
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 278
- 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 229
- 2020Language Conditioned Imitation Learning over Unstructured Datacited by 208
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2023Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisitioncited by 156
- 2019A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithmscited by 136
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
- 2024One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillationcited by 83
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policycited by 73
- 2024The Ingredients for Robotic Diffusion Transformerscited by 72
- 2023SkillDiffuser: Interpretable Hierarchical Planning via Skill Abstractions in Diffusion-Based Task Executioncited by 69
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 59
- 2024Sparse Diffusion Policy: A Sparse, Reusable, and Flexible Policy for Robot Learningcited by 56
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2023PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Playcited by 48
- 2020ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulationcited by 47
- 2023RobotGPT: Robot Manipulation Learning from ChatGPTcited by 39
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 7.
8 papers.
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2025VLA-LPAF: Lightweight Perspective-Adaptive Fusion for Vision-Language-Action to Enable More Unconstrained Robotic Manipulationcited by 3
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Modelcited by 3
- 2026CorridorVLA: Explicit Spatial Constraints for Generative Action Heads via Sparse Anchorscited by 1
- 2026See like a Robot: Robot-Centric Pointmaps for VLA Modelscited by 1
- 2026Cross-View Action Consistency for Camera-Robust Vision-Language-Action Policiescited by 1
- 2026Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Modelscited by 0
- 2026InfiNoVA: Infinite Novel View Augmentation for Viewpoint Invariant Robot Policiescited by 0
- 2026InfiNoVA: Infinite Novel View Augmentation for Viewpoint Invariant Robot Policies23 Sep 2026
- 2026Hierarchical Skill Retrieval for Data-Efficient Adaptation of Vision-Language-Action Models25 Aug 2026
- 2026Cross-View Action Consistency for Camera-Robust Vision-Language-Action Policies7 Aug 2026
- 2026See like a Robot: Robot-Centric Pointmaps for VLA Models13 Jul 2026
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model6 Jul 2026
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Models16 Jun 2026
- 2026CorridorVLA: Explicit Spatial Constraints for Generative Action Heads via Sparse Anchors23 Apr 2026
- 2025VLA-LPAF: Lightweight Perspective-Adaptive Fusion for Vision-Language-Action to Enable More Unconstrained Robotic Manipulation18 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025cVLA: Towards Efficient Camera-Space VLAs
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2026The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection
- 2025Clutter-Robust Vision-Language-Action Models through Object-Centric and Geometry Grounding
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
- 2026OC-VLA++: Monocular Geometry-Guided Cross-View Consistency for Viewpoint-Robust Robotic Manipulation
- 2026GWM-VLA: Geometry-Aware Latent World Modeling for Vision-Language-Action Learning
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model