DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow
Not on the map. Why?
Abstract (arXiv)
Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to enhance these generated 3D shapes. Our key insight is to model the coarse-to-fine transformation directly through data-dependent flows in latent space, avoiding the computational overhead of large-scale 3D generative models. We introduce a token matching strategy that ensures accurate spatial correspondence during refinement, enabling local detail synthesis while preserving global structure. By carefully designing our training data to match the characteristics of synthesized coarse shapes, our method can effectively enhance shapes produced by various 3D generation and reconstruction approaches, from single-view to sparse multi-view inputs. Extensive experiments demonstrate that DetailGen3D achieves high-fidelity geometric detail synthesis while maintaining efficiency in training.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 73 of its 96 references that are in the map. First posted on arXiv 25 Nov 2024.
Builds on
73 of 96 references.
References · 73
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 6.
11 papers.
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2025SAT-SKYLINES: 3D Building Generation from Satellite Imagery and Coarse Geometric Priorscited by 3
- 2025SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generationcited by 2
- 2026MeshReGen: A Unified 3D Geometry Regeneration Frameworkcited by 1
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulationcited by 1
- 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Controlcited by 0
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characterscited by 0
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusioncited by 0
- 2026DistScene: Object-to-Scene Distillation for 3D Scene Generationcited by 0
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generationcited by 0
- 2026ScenePlacer: Reformulating Scene-Level Object Pose Estimation as Visibility Field Learningcited by 0
- 2026ScenePlacer: Reformulating Scene-Level Object Pose Estimation as Visibility Field Learning11 Oct 2026
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation9 Oct 2026
- 2026DistScene: Object-to-Scene Distillation for 3D Scene Generation3 Oct 2026
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulation10 Sep 2026
- 2026PLSR: Progressive and Localized Super-Resolution of 3D Objects via Localized Latent Voxel Diffusion6 Sep 2026
- 2026MeshReGen: A Unified 3D Geometry Regeneration Framework30 Apr 2026
- 2025Make-It-Poseable: Feed-forward Latent Posing Model for 3D Characters18 Dec 2025
- 2025SAT-SKYLINES: 3D Building Generation from Satellite Imagery and Coarse Geometric Priors25 Aug 2025
- 2025AutoPartGen: Autogressive 3D Part Generation and Discovery17 Jul 2025
- 2025SuperCarver: Texture-Consistent 3D Geometry Super-Resolution for High-Fidelity Surface Detail Generation12 Mar 2025
- 2025Dragen3D: Multiview Geometry Consistent 3D Gaussian Generation with Drag-Based Control23 Feb 2025