mlsanityData to 14 Oct 2026

WorldAlign: Decoupled 4D Reward for World-Consistent Video Generation

arXiv 2610.12382 ↗First posted 8 Oct 2026cs.CVcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Faithful visual world simulation requires generated videos to maintain 4D world consistency, encompassing both static and dynamic consistency. Static consistency requires coherent 3D structure in static environments across viewpoints, while dynamic consistency requires plausible subject motion and consistent appearance over time. Geometry-aware post-training offers a promising way to improve world consistency. However, existing methods often rely on a static-scene assumption. Even those that accommodate dynamic scenes struggle to provide reliable static-consistency feedback, while dynamic consistency is often overlooked or inadequately assessed. To address these limitations, we introduce WorldAlign, a decoupled 4D reward framework that semantically separates static regions and dynamic subjects and provides feedback by aligning each with a world prior suited to its assumptions. For static regions, WorldAlign aligns static geometry with a geometric world prior through semantically guided masked reprojection, enabling more reliable static-consistency evaluation; an auxiliary camera-motion reward discourages nearly static solutions. For dynamic subjects, WorldAlign uses a strong vision-language model (VLM) as a dynamic world prior and constructs a VLM-as-a-judge reward based on sample-specific checklists that assess dynamicity, physical plausibility, shape, and texture consistency. This decoupled design enables more effective online post-training without requiring human preference annotations. Across two pretrained image-to-video generators, Wan2.1 and Wan2.2, WorldAlign jointly improves static and dynamic consistency over existing methods without suppressing overall or subject motion. These results support decoupled world-prior alignment for more faithful visual world simulation. Project page: https://worldalign.github.io/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 38 of its 40 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

38 of 40 references.

References · 38

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2025DINOv3cited by 1,414
  12. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 957
26 more
  1. 2025SAM 3: Segment Anything with Conceptscited by 906
  2. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  3. 2024Genie: Generative Interactive Environmentscited by 747
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  5. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  6. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  7. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  8. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  9. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  10. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 170
  11. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  12. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
  13. 2025Kling-Omni Technical Reportcited by 71
  14. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
  15. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
  16. 2026DreamX-World 1.0: A General-Purpose Interactive World Modelcited by 40
  17. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 38
  18. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easycited by 34
  19. 2025Epipolar Geometry Improves Video Generation Modelscited by 26
  20. 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
  21. 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 23
  22. 2025GeoVideo: Introducing Geometric Regularization into Video Generation Modelcited by 19
  23. 2026World-R1: Reinforcing 3D Constraints for Text-to-Video Generationcited by 11
  24. 2026PhysisForcing: Physics Reinforced World Simulator for Robotic Manipulationcited by 10
  25. 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generationcited by 2
  26. 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling
  2. 2026GeoFix: Geometry Fixing for 4D Consistent Generation
  3. 20254DWorldBench: A Comprehensive Evaluation Framework for 3D/4D World Generation Models
  4. 2025IC-World: In-Context Generation for Shared World Modeling
  5. 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward
  6. 2026Orbia: Do Generated Videos Form a Consistent 3D World?
  7. 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling
  8. 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generation