NOVA3D: Normal Aligned Video Diffusion Model for Single Image to 3D Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D AI-generated content (AIGC) has made it increasingly accessible for anyone to become a 3D content creator. While recent methods leverage Score Distillation Sampling to distill 3D objects from pretrained image diffusion models, they often suffer from inadequate 3D priors, leading to insufficient multi-view consistency. In this work, we introduce NOVA3D, an innovative single-image-to-3D generation framework. Our key insight lies in leveraging strong 3D priors from a pretrained video diffusion model and integrating geometric information during multi-view video fine-tuning. To facilitate information exchange between color and geometric domains, we propose the Geometry-Temporal Alignment (GTA) attention mechanism, thereby improving generalization and multi-view consistency. Moreover, we introduce the de-conflict geometry fusion algorithm, which improves texture fidelity by addressing multi-view inaccuracies and resolving discrepancies in pose alignment. Extensive experiments validate the superiority of NOVA3D over existing baselines.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 24 of its 28 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
24 of 28 references.
Closest ancestors · 11
Same direction, newest first
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
- 2024Envision3D: One Image to 3D with Anchor Views Interpolation13 Mar
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 13
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
1 more
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models
- 2024V3D: Video Diffusion Models are Effective 3D Generators
- 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Models
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modeling
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generation
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models