The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models have shown remarkable promise in generalized robotic manipulation. However, their spatial generalization remains fragile. We argue that simply increasing the number of viewpoints is insufficient. Models often fall into the trap of Shortcut Learning, latching onto spurious correlations (e.g., fixed relative poses between objects or between the camera and robot base) rather than learning true spatial relationships. In this work, we propose a data-centric solution to enhance VLA spatial generalization. We utilize a dual-arm setup where one arm performs manipulation while the other serves as a mobile environmental camera. We systematically evaluate three data distribution patterns: Fixed, Multi-Fixed, and Moving Views. Our findings reveal that a hybrid strategy, combining continuous camera motion with diverse static viewpoints, yields the best performance by substantially reducing spurious correlations while maintaining training stability. Our experiments demonstrate that this strategy mitigates spurious correlations, enabling VLAs to generalize to unseen camera poses and object configurations where simply adding more static viewpoints fails. Crucially, we reveal that the susceptibility to shortcut learning and the struggle with spatial generalization are universal characteristics shared across diverse architectures. Consequently, all evaluated models (ACT, Diffusion, and VLA models including Pi0 and Gr00t) benefit significantly from our mixed data strategy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 24 of its 26 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
24 of 26 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2023Multi-View Masked World Models for Visual Robotic Manipulationcited by 78
- 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 78
- 2025Novel Demonstration Generation with Gaussian Splatting Enables Robust One-Shot Manipulationcited by 45
- 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesiscited by 35
- 2025Vision in Action: Learning Active Perception from Human Demonstrationscited by 33
11 more
- 2024SPA: 3D Spatial-Awareness Enables Effective Embodied Representationcited by 28
- 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
- 2025Do You Know Where Your Camera Is? View-Invariant Policy Learning with Camera Conditioningcited by 14
- 2025VLA Models Are More Generalizable Than You Think: Revisiting Physical and Spatial Modelingcited by 11
- 2025Adversarial Data Collection: Human-Collaborative Perturbations for Efficient and Robust Robotic Imitation Learningcited by 9
- 2023Visual-Policy Learning through Multi-Camera View to Single-Camera View Knowledge Distillation for Robot Manipulation Taskscited by 7
- 2025ManiVID-3D: Generalizable View-Invariant Reinforcement Learning for Robotic Manipulation via Disentangled 3D Representationscited by 5
- 2025Invariance Co-training for Robot Visual Generalizationcited by 4
- 2026RADAR: Benchmarking Vision-Language-Action Generalization via Real-World Dynamics, Spatial-Physical Intelligence, and Autonomous Evaluationcited by 4
- 2025MOVE: A Simple Motion-Based Data Collection Paradigm for Spatial Generalization in Robotic Manipulationcited by 3
- 2025Viewpoint-Agnostic Manipulation Policies with Strategic Vantage Selectioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Generalizable Robotic Manipulation in Dynamic Environments
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model
- 2026GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning
- 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
- 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models