mlsanityData to 7 Oct 2026

GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis

arXiv 2603.14965 ↗First posted 16 Mar 2026cs.CVcited by 3

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Novel view synthesis requires strong 3D geometric consistency and the ability to generate visually coherent images across diverse viewpoints. While recent camera-controlled video diffusion models show promising results, they often suffer from geometric distortions and limited camera controllability. To overcome these challenges, we introduce GeoNVS, a geometry-grounded novel-view synthesizer that enhances both geometric fidelity and camera controllability through explicit 3D geometric guidance. Our key innovation is the Gaussian Splat Feature Adapter (GS-Adapter), which lifts input-view diffusion features into 3D Gaussian representations, renders geometry-constrained novel-view features, and adaptively fuses them with diffusion features to correct geometrically inconsistent representations. Unlike prior methods that inject geometry at the input level, GS-Adapter operates in feature space, avoiding view-dependent color noise that degrades structural consistency. Its plug-and-play design enables zero-shot compatibility with diverse feed-forward geometry models without additional training, and can be adapted to other video diffusion backbones. Experiments across 9 scenes and 18 settings demonstrate state-of-the-art performance, achieving 11.3% and 14.9% improvements over SEVA and CameraCtrl, with up to 2x reduction in translation error and 7x in Chamfer Distance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 83 of its 94 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

83 of 94 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priors13 Aug
  2. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling10 Jul
  3. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
  4. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
  5. 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model25 Nov
  6. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors21 Oct
  7. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
  8. 2024Controlling Space and Time with Diffusion Models10 Jul
  9. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
  10. 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
  11. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr

Other references · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Segment Anythingcited by 8,158
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  10. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  12. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
38 more
  1. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  2. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  3. 2021Vision Transformers for Dense Predictioncited by 1,789
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  7. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  8. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  9. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  10. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  11. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  12. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  13. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  14. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  15. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  16. 2023LERF: Language Embedded Radiance Fieldscited by 538
  17. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  18. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  19. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  20. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  21. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 361
  22. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  23. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  24. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  25. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  26. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  27. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  28. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  29. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
  30. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  31. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  32. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  33. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  34. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
  35. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  36. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  37. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 162
  38. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 161

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026OrbitNVS: Harnessing Video Diffusion Priors for Novel View Synthesis
  2. 2026GenNVS: Geometry-enhanced Novel View Synthesis via Disentangled 3D Prior
  3. 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
  4. 2026GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
  5. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  6. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  7. 2026Repurposing Geometric Foundation Models for Multi-view Diffusion
  8. 2024Novel View Synthesis with Pixel-Space Diffusion Models