mlsanityData to 7 Oct 2026

PAIWorld: A 3D-Consistent World Foundation Model for Robotic Manipulation

arXiv 2606.18375 ↗First posted 16 Jun 2026cs.ROcited by 4

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World foundation models (WFMs) are powerful simulators, yet they predominantly operate in a single-view setting and lack the multi-view 3D consistency required for robotic manipulation. While robotic systems rely on multiple cameras (egocentric, eye-to-hand, and wrist-mounted) for policy learning, current multi-view world models simply concatenate view tokens without explicit geometric reasoning. This causes cross-view object drift, depth inconsistency, and texture misalignment. We trace these failures to two deficiencies: the absence of an explicit inter-view communication mechanism and the lack of a 3D geometric prior. We argue that resolving both simultaneously is necessary and sufficient. To address this, we present PAIWorld, a framework that augments diffusion-transformer world models via three core components: (1) Geometry-Aware Cross-View Attention blocks that establish an explicit pathway across views, (2) Geometric Rotary Position Embedding that encodes camera ray directions and extrinsic poses into the attention mechanism, and (3) Latent 3D-REPA, which distills 3D-aware features from frozen 3D foundation models to ensure 3D consistency. Built upon a DiT-based world foundation model, PAIWorld achieves state-of-the-art multi-view 3D consistency on robotic manipulation benchmarks, ranking 1st on the WorldArena leaderboard and 2nd on the AgiBot-Challenge2026 leaderboard, while enabling downstream applications such as model-based planning, world action models, and multi-view policy post-training.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 20 of its 60 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

20 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  2. 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May

Other references · 18

  1. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  2. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2018World Modelscited by 1,444
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  6. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  7. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  8. 2025World Simulation with Video Foundation Models for Physical AIcited by 183
  9. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  10. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 159
  11. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  12. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
6 more
  1. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
  2. 2025Galaxea Open-World Dataset and G0 Dual-System VLA Modelcited by 90
  3. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  4. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  5. 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 40
  6. 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Actioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation
  2. 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
  3. 2026WSA1: a 3D-Centric World-Spatial-Action Model for Generalizable Robot Control
  4. 2026DepthWorld: 3D World Model for Robot Manipulation
  5. 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation
  6. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
  7. 2026TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models
  8. 2025SPEAR-1: Scaling Beyond Robot Demonstrations via 3D Understanding