mlsanityData to 14 Oct 2026

GenVDM: Generating Vector Displacement Maps From a Single Image

arXiv 2503.00605 ↗First posted 1 Mar 2025cs.GR cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce the first method for generating Vector Displacement Maps (VDMs): parameterized, detailed geometric stamps commonly used in 3D modeling. Given a single input image, our method first generates multi-view normal maps and then reconstructs a VDM from the normals via a novel reconstruction pipeline. We also propose an efficient algorithm for extracting VDMs from 3D objects, and present the first academic VDM dataset. Compared to existing 3D generative models focusing on complete shapes, we focus on generating parts that can be seamlessly attached to shape surfaces. The method gives artists rich control over adding geometric details to a 3D shape. Experiments demonstrate that our approach outperforms existing baselines. Generating VDMs offers additional benefits, such as using 2D image editing to customize and refine 3D details.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 89 references that are in the map. First posted on arXiv 1 Mar 2025.

Builds on

49 of 89 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  4. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  6. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  10. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  11. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  12. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
37 more
  1. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  2. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  3. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  4. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  5. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  6. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  7. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  8. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  10. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  12. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  13. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  14. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  15. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  16. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  17. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  18. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  19. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 343
  20. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 333
  21. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  22. 2022Novel View Synthesis with Diffusion Modelscited by 300
  23. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  24. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  25. 2023Scalable 3D Captioning with Pretrained Modelscited by 203
  26. 2020FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Predictioncited by 196
  27. 2019Tex2Shape: Detailed Full Human Body Geometry From a Single Imagecited by 166
  28. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  29. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
  30. 2018Deep Geometric Prior for Surface Reconstructioncited by 110
  31. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  32. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  33. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
  34. 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
  35. 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusioncited by 22
  36. 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
  37. 2024Text-guided Controllable Mesh Refinement for Interactive 3D Modelingcited by 7

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 99