VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment
On the map: Diffusion models → 3D, point cloud and scene generation
also in 1 more
Abstract (arXiv)
Video diffusion models lack explicit geometric supervision during training, leading to inconsistency artifacts such as object deformation, spatial drift, and depth violations in generated videos. To address this limitation, we propose a geometry-based reward model that leverages pretrained geometric foundation models to evaluate multi-view consistency through cross-frame reprojection error. Unlike previous geometric metrics that measure inconsistency in pixel space, where pixel intensity may introduce additional noise, our approach conducts error computation in a pointwise fashion, yielding a more physically grounded and robust error metric. Furthermore, we introduce a geometry-aware sampling strategy that filters out low-texture and non-semantic regions, focusing evaluation on geometrically meaningful areas with reliable correspondences to improve robustness. We apply this reward model to align video diffusion models through two complementary pathways: post-training of a bidirectional model via SFT or Reinforcement Learning and inference-time optimization of a Causal Video Model (e.g., Streaming video generator) via test-time scaling with our reward as a path verifier. Experimental results validate the effectiveness of our design, demonstrating that our geometry-based reward provides superior robustness compared to other variants. By enabling efficient inference-time scaling, our method offers a practical solution for enhancing open-source video models without requiring extensive computational resources for retraining.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 50 of its 54 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
50 of 54 references.
Closest ancestors · 3
Same direction, newest first
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation30 Jan
- 2025Epipolar Geometry Improves Video Generation Models24 Oct
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation4 Jun
Other references · 47
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
35 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 431
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 418
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 305
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 225
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2025Reward Forcing: Efficient Streaming Video Generation with Rewarded Distribution Matching Distillationcited by 75
- 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 48
- 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 33
- 2025Soft Best-of-n Sampling for Model Alignmentcited by 28
- 2025VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstructioncited by 26
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformerscited by 19
- 2024AKiRa: Augmentation Kit on Rays for optical video generationcited by 17
- 2026VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detectioncited by 6
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generation30 Sep 2026
- 2026SCOPE: Score-Isolated Agentic Optimization for Video World Models15 Aug 2026
- 2026GEOPHYS: The Geometry of Physical Plausibility15 Jun 2026
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward22 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward
- 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
- 2026CamPilot: Improving Camera Control in Video Diffusion Model with Efficient Camera Reward Feedback
- 2024Video Diffusion Alignment via Reward Gradients
- 2026Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching