Measuring 3D Spatial Geometric Consistency in Dynamic Video Generation
Not on the map. Why?
Abstract (arXiv)
Recent generative models can produce high-fidelity videos, yet they often exhibit 3D spatial geometric inconsistencies. Existing evaluation methods fail to accurately characterize these inconsistencies: fidelity-centric metrics like FVD are insensitive to geometric distortions, while consistency-focused benchmarks often penalize valid foreground dynamics. To address this gap, we introduce SGC, a metric for evaluating 3D Spatial Geometric Consistency in dynamically generated videos. We quantify geometric consistency by measuring the divergence among multiple camera poses estimated from distinct local regions. Our approach first separates static from dynamic regions, then partitions the static background into spatially coherent sub-regions. We predict depth for each pixel, estimate a local camera pose for each subregion, and compute the divergence among these poses to quantify geometric consistency. Experiments on real and generative videos demonstrate that SGC robustly quantifies geometric inconsistencies, effectively identifying critical failures missed by existing metrics.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 50 of its 54 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
50 of 54 references.
References · 50
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2023ModelScope Text-to-Video Technical Reportcited by 651
38 more
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Modelscited by 349
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 231
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 202
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 130
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 114
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
- 2024DELTA: Dense Efficient Long-range 3D Tracking for any videocited by 62
- 2024Fr'echet Video Motion Distance: A Metric for Evaluating Motion Consistency in Videoscited by 54
- 2024On the Content Bias in Fr'echet Video Distancecited by 51
- 2024Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditionscited by 42
- 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 41
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 32
- 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
- 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Modelscited by 25
- 2024Hierarchical Patch Diffusion Models for High-Resolution Video Generationcited by 24
- 2024Beyond FVD: Enhanced Evaluation Metrics for Video Generation Qualitycited by 21
- 2025Direct Motion Models for Assessing Generated Videoscited by 10
- 2024Inflation with Diffusion: Efficient Temporal Adaptation for Text-to-Video Super-Resolutioncited by 9
- 2025PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perceptioncited by 7
- 2025C-Drag: Chain-of-Thought Driven Motion Controller for Video Generationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.