GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Novel view synthesis requires strong 3D geometric consistency and the ability to generate visually coherent images across diverse viewpoints. While recent camera-controlled video diffusion models show promising results, they often suffer from geometric distortions and limited camera controllability. To overcome these challenges, we introduce GeoNVS, a geometry-grounded novel-view synthesizer that enhances both geometric fidelity and camera controllability through explicit 3D geometric guidance. Our key innovation is the Gaussian Splat Feature Adapter (GS-Adapter), which lifts input-view diffusion features into 3D Gaussian representations, renders geometry-constrained novel-view features, and adaptively fuses them with diffusion features to correct geometrically inconsistent representations. Unlike prior methods that inject geometry at the input level, GS-Adapter operates in feature space, avoiding view-dependent color noise that degrades structural consistency. Its plug-and-play design enables zero-shot compatibility with diverse feed-forward geometry models without additional training, and can be adapted to other video diffusion backbones. Experiments across 9 scenes and 18 settings demonstrate state-of-the-art performance, achieving 11.3% and 14.9% improvements over SEVA and CameraCtrl, with up to 2x reduction in translation error and 7x in Chamfer Distance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 83 of its 94 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
83 of 94 references.
Closest ancestors · 11
Same direction, newest first
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling10 Jul
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
- 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model25 Nov
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors21 Oct
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024Controlling Space and Time with Diffusion Models10 Jul
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
Other references · 72
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
38 more
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
- 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis
- 2026GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
- 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
- 2026Repurposing Geometric Foundation Models for Multi-view Diffusion
- 2024Novel View Synthesis with Pixel-Space Diffusion Models