Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models (WAMs) jointly denoise future video frames and robot actions, and the video prior is expected to generalize their control. Camera viewpoint change remains one of their hardest perturbation axes. We study a question specific to this model class: when training with same-state cross-view image pairs, on which output coordinates should a consistency loss be imposed? The WAM denoising target mixes view-covariant coordinates, namely the predicted future scene, with view-invariant coordinates, namely the action chunk, future proprioception, and value. We show that consistency applied to the covariant block is provably harmful, shrinking legitimate view-specific content to a fraction 1/(1+4λ) of its true value, and we verify this shrinkage law in controlled experiments. Selective cross-view consistency (SCVC) therefore constrains only the invariant block, requires no camera labels, extrinsics, depth, or view synthesis at training or test time, and leaves the deployment interface unchanged. We introduce a carve-and-hold-out evaluation protocol on the LIBERO-Plus camera track that separates a distribution-matched ceiling from genuine interpolation and extrapolation to held-out viewpoints, with a matched pair-trained control isolating the effect of the consistency term from pair exposure. On held-out orbital viewpoints beyond the training envelope, SCVC improves closed-loop success over the matched control by 12.2 points (95% CI [7.4, 17.0]; +15.5, CI [11.7, 19.4], under an independent second seed) -- an effect two further camera axes replicate -- while interpolation within the envelope shows no gain in either seed (-1.2 and -4.3 points) and in-distribution competence is preserved (-0.6, -0.2). We also report a cross-backbone audit showing that published camera-robustness numbers are confounded by wrist-camera pose stability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 21 of its 27 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
21 of 27 references.
Closest ancestors · 5
Same direction, newest first
- 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Models10 Jun
- 2026World Action Models: The Next Frontier in Embodied AI12 May
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study23 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
Other references · 16
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,054
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2024EquiBot: SIM(3)-Equivariant Diffusion Policy for Generalizable and Data Efficient Learningcited by 72
- 2024Equivariant Diffusion Policycited by 61
- 2024RoVi-Aug: Robot and Viewpoint Augmentation for Cross-Embodiment Robot Learningcited by 46
- 2024View-Invariant Policy Learning via Zero-Shot Novel View Synthesiscited by 35
- 2022Sample Efficiency of Data Augmentation Consistency Regularizationcited by 28
- 2025Do You Know Where Your Camera Is? View-Invariant Policy Learning with Camera Conditioningcited by 14
4 more
- 2026AnyCamVLA: Zero-Shot Camera Adaptation for Viewpoint Robust Vision-Language-Action Modelscited by 7
- 2026Learning to Act Robustly with View-Invariant Latent Actionscited by 6
- 2026Beyond Viewpoint Generalization: What Multi-View Demonstrations Offer and How to Synthesize Them for Robot Manipulation?cited by 3
- 2026VistaBot: View-Robust Robot Manipulation via Spatiotemporal-Aware View Synthesiscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026World-Action Models for Robot Learning and Control: A Survey13 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Cross-View Action Consistency for Camera-Robust Vision-Language-Action Policies
- 2026C3ache: Accelerating World Action Models with Cross Inference Chunk Cache
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
- 2026Robust-WAM: Bridging Generative Pretraining and Semantic Foresight in World-Action Models
- 2026Flash-WAM: Modality-Aware Distillation for World Action Models
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026CtrlWAM: Controllable World Action Models with Aligned Intent and Foresight
- 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement