Epipolar Geometry Improves Video Generation Models
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Video generation models have advanced significantly through the latent diffusion transformers trained with rectified flow techniques. Yet these models still struggle with geometric inconsistencies, unstable motion, and visual artifacts that break the illusion of realistic 3D scenes. 3D-consistent video generation could significantly impact numerous downstream applications in generation and reconstruction tasks. We explore how epipolar geometry constraints improve modern video diffusion models. Despite using massive training data, these models fail to capture fundamental geometric principles. We align diffusion models using pairwise epipolar geometry constraints via preference-based optimization, directly addressing unstable trajectories and geometric artifacts through mathematically principled geometric enforcement. Our approach efficiently enforces geometric principles without requiring end-to-end differentiability. Evaluation demonstrates that classical geometric constraints provide more stable optimization signals than modern learned metrics. Training on static scenes with dynamic cameras ensures metric quality while the model generalizes to various dynamic scenes. By bridging data-driven learning with classical computer vision, we reduce epipolar error by 31% and improve human-rated consistency from 54% to 72% without compromising visual quality.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 43 of its 60 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
43 of 60 references.
Closest ancestors · 6
Same direction, newest first
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
- 2024World-consistent Video Diffusion with Explicit 3D Modeling2 Dec
- 2024Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models11 Sep
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
- 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar
Other references · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
25 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 146
- 2024Training-free Camera Control for Video Generationcited by 122
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Modelcited by 120
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 98
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 95
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2025PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Dropcited by 50
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
- 2025RealCam-Vid: High-resolution Video Dataset with Dynamic Scenes and Metric-scale Camera Movementscited by 14
Built on by
Citing papers per year: 2025: 1; 2026: 25.
26 papers.
Sort:
By area:
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 23
- 2026Geometry-Aware Implicit Memory for Video World Modelscited by 13
- 2026ViMax: Agentic Video Generationcited by 12
- 2026World Reconstruction From Inconsistent Viewscited by 8
- 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignmentcited by 7
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Rewardcited by 3
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generationcited by 2
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidancecited by 2
14 more
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Modelcited by 2
- 2026Probing into Camera Control of Video Modelscited by 1
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Viewscited by 1
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generationcited by 0
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Modelscited by 0
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priorscited by 0
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generationcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generationcited by 0
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generationcited by 0
- 2026WorldAlign: Decoupled 4D Reward for World-Consistent Video Generationcited by 0
- 2026GeoFix: Geometry Fixing for 4D Consistent Generationcited by 0
- 2026GeoFix: Geometry Fixing for 4D Consistent Generation9 Oct 2026
- 2026WorldAlign: Decoupled 4D Reward for World-Consistent Video Generation8 Oct 2026
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generation2 Oct 2026
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation1 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generation30 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026Off-Manifold Refinement: Guiding Video Generators with a Frozen World Model30 Aug 2026
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors24 Aug 2026
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models20 Aug 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generation15 Jun 2026
14 more
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling12 Jun 2026
- 2026ViMax: Agentic Video Generation2 Jun 2026
- 2026Geometry-Aware Implicit Memory for Video World Models1 Jun 2026
- 2026Drift-Resistant Navigation World Model with Anchored Epipolar Guidance23 May 2026
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward22 May 2026
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Views19 May 2026
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation18 May 2026
- 2026Probing into Camera Control of Video Models14 May 2026
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward27 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026World Reconstruction From Inconsistent Views17 Mar 2026
- 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment17 Mar 2026
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation30 Jan 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 23
- 2026World Reconstruction From Inconsistent Viewscited by 8
- 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignmentcited by 7
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modelingcited by 7
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generationcited by 2
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generationcited by 0
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generationcited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Modelscited by 0
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generationcited by 0
- 2026GeoFix: Geometry Fixing for 4D Consistent Generationcited by 0
- 2026GeoFix: Geometry Fixing for 4D Consistent Generation9 Oct 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models20 Aug 2026
- 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation23 Jun 2026
- 2026MMDiff: Extending Diffusion Transformers for Multi-Modal Generation15 Jun 2026
- 2026VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling12 Jun 2026
- 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generation18 May 2026
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward27 Mar 2026
- 2026World Reconstruction From Inconsistent Views17 Mar 2026
- 2026VIGOR: VIdeo Geometry-Oriented Reward for Temporal Generative Alignment17 Mar 2026
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation30 Jan 2026
- 2026ViMax: Agentic Video Generationcited by 12
- 2026ViMax: Agentic Video Generation2 Jun 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstructioncited by 4
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Rewardcited by 3
- 2026Probing into Camera Control of Video Modelscited by 1
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Viewscited by 1
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priorscited by 0
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generationcited by 0
- 2026Video Generation Models: A Survey of Post-Training and Alignmentcited by 0
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generationcited by 0
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generationcited by 0
- 2026LoGo: Local-Global Rewards for Consistent Long-Horizon Video Generation2 Oct 2026
- 2026HiPhy: Hierarchical Alignment for Physically-Plausible Multi-Principle Video Generation1 Oct 2026
- 2026Video Generation Models: A Survey of Post-Training and Alignment30 Sep 2026
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generation30 Sep 2026
- 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors24 Aug 2026
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward22 May 2026
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Views19 May 2026
- 2026Probing into Camera Control of Video Models14 May 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2025GaMO: Geometry-aware Multi-view Diffusion Outpainting for Sparse-View 3D Reconstruction31 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
- 2026PE-Field 4D: Video Generation Models as Canvas
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
- 2025Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training
- 2025Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Models
- 2025VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Step
- 2025View-Consistent Diffusion Representations for 3D-Consistent Video Generation
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion