PAIWorld: A 3D-Consistent World Foundation Model for Robotic Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World foundation models (WFMs) are powerful simulators, yet they predominantly operate in a single-view setting and lack the multi-view 3D consistency required for robotic manipulation. While robotic systems rely on multiple cameras (egocentric, eye-to-hand, and wrist-mounted) for policy learning, current multi-view world models simply concatenate view tokens without explicit geometric reasoning. This causes cross-view object drift, depth inconsistency, and texture misalignment. We trace these failures to two deficiencies: the absence of an explicit inter-view communication mechanism and the lack of a 3D geometric prior. We argue that resolving both simultaneously is necessary and sufficient. To address this, we present PAIWorld, a framework that augments diffusion-transformer world models via three core components: (1) Geometry-Aware Cross-View Attention blocks that establish an explicit pathway across views, (2) Geometric Rotary Position Embedding that encodes camera ray directions and extrinsic poses into the attention mechanism, and (3) Latent 3D-REPA, which distills 3D-aware features from frozen 3D foundation models to ensure 3D consistency. Built upon a DiT-based world foundation model, PAIWorld achieves state-of-the-art multi-view 3D consistency on robotic manipulation benchmarks, ranking 1st on the WorldArena leaderboard and 2nd on the AgiBot-Challenge2026 leaderboard, while enabling downstream applications such as model-based planning, world action models, and multi-view policy post-training.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 60 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
20 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May
Other references · 18
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2018World Modelscited by 1,444
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025World Simulation with Video Foundation Models for Physical AIcited by 183
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
6 more
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
- 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 40
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Actioncited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Modelscited by 5
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026HyBDM: Multi-Scale Hybrid Experts for Time Series Forecasting with Bidirectional Dependency Modelingcited by 0
- 2026RoboCoach: World Models as Active Coaches for Compositional Robot Skillscited by 0
- 2026RoboCoach: World Models as Active Coaches for Compositional Robot Skills30 Sep 2026
- 2026Is Forward Prediction Enough? Physical State Grounding for JEPA World Models7 Aug 2026
- 2026HyBDM: Multi-Scale Hybrid Experts for Time Series Forecasting with Bidirectional Dependency Modeling18 Jul 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation
- 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
- 2026WSA1: a 3D-Centric World-Spatial-Action Model for Generalizable Robot Control
- 2026DepthWorld: 3D World Model for Robot Manipulation
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
- 2026TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models
- 2025SPEAR-1: Scaling Beyond Robot Demonstrations via 3D Understanding