Multi-View Unified Camera Fields: Geometry-Shaped Action-Facing Representations for RGB-Only Multi-Camera VLA Policies
On the map: Vision-language-action models → 3D and spatial-aware VLA
Abstract (arXiv)
Vision-Language-Action (VLA) models have shown strong generalization in robotic manipulation, yet complex contact-rich tasks often benefit from multi-camera observations that jointly capture the end effector, objects, and targets under occlusion. Existing multi-camera VLAs usually concatenate view tokens, leaving action representations weak in metric depth and inconsistent across cameras. We introduce Multi-View Unified Camera Fields (MVUCF), a training-only framework that forms a shared action-facing latent field across views. A coordinate-query depth objective makes metric depth recoverable, while a preprocessing-aware correspondence objective aligns tokens observing the same physical point from different cameras. Both directly shape the hidden states consumed by the action module. After geometry injection, depth, camera calibration, and auxiliary heads are removed, so deployment uses the original RGB-only graph with no extra inference FLOPs. Held-out probes confirm stronger depth recovery and cross-view matching. Under matched GR00T-N1.6 settings, MVUCF reaches 98.9% on LIBERO, improves LIBERO-Plus by 22.4 points, and raises success by 23.3 points across six RoboTwin tasks spanning three action families: touch, move-and-place, and contact interaction. Real-world humanoid experiments further provide evidence of its practical effectiveness under RGB-only deployment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in 3D and spatial-aware VLA, one of 13 directions in Vision-language-action models. Builds on 17 of its 28 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
17 of 28 references.
Closest ancestors · 3
Same direction, newest first
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model14 May
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model14 Oct
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policies13 Dec
Other references · 14
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026OC-VLA++: Monocular Geometry-Guided Cross-View Consistency for Viewpoint-Robust Robotic Manipulation
- 2025Grounding Actions in Camera Space: Observation-Centric Vision-Language-Action Policy
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation
- 2026GWM-VLA: Geometry-Aware Latent World Modeling for Vision-Language-Action Learning
- 2026UniviewVLA: A Unified Multiview Vision-Language-Action Model with World Modeling
- 2026G3VLA: Geometric inductive bias for Vision-Language-Action Models
- 2026From Fixed to Free Cameras: Calibration-Free View-Robust Vision-Language-Action Model
- 2026Cross-View Action Consistency for Camera-Robust Vision-Language-Action Policies