mlsanityData to 14 Oct 2026

DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow

arXiv 2411.16820 ↗First posted 25 Nov 2024cs.CV cs.GRcited by 11

Not on the map. Why?

Abstract (arXiv)

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to enhance these generated 3D shapes. Our key insight is to model the coarse-to-fine transformation directly through data-dependent flows in latent space, avoiding the computational overhead of large-scale 3D generative models. We introduce a token matching strategy that ensures accurate spatial correspondence during refinement, enabling local detail synthesis while preserving global structure. By carefully designing our training data to match the characteristics of synthesized coarse shapes, our method can effectively enhance shapes produced by various 3D generation and reconstruction approaches, from single-view to sparse multi-view inputs. Extensive experiments demonstrate that DetailGen3D achieves high-fidelity geometric detail synthesis while maintaining efficiency in training.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 73 of its 96 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

73 of 96 references.

References · 73

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  9. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  10. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  11. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
  1. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  2. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  3. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  4. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  7. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  8. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  9. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  10. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  12. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  13. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  14. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  15. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  16. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  17. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  18. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  19. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  20. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  21. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  22. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
  23. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  24. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  25. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  26. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  27. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  28. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  29. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  30. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  31. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  32. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  33. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  34. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  35. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  36. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  37. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  38. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 189

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.