Single Image to High-Quality 3D Object via Latent Features
Not on the map. Why?
Abstract (arXiv)
3D assets are essential in the digital age. While automatic 3D generation, such as image-to-3d, has made significant strides in recent years, it often struggles to achieve fast, detailed, and high-fidelity generation simultaneously. In this work, we introduce LatentDreamer, a novel framework for generating 3D objects from single images. The key to our approach is a pre-trained variational autoencoder that maps 3D geometries to latent features, which greatly reducing the difficulty of 3D generation. Starting from latent features, the pipeline of LatentDreamer generates coarse geometries, refined geometries, and realistic textures sequentially. The 3D objects generated by LatentDreamer exhibit high fidelity to the input images, and the entire generation process can be completed within a short time (typically in 70 seconds). Extensive experiments show that with only a small amount of training, LatentDreamer demonstrates competitive performance compared to contemporary approachs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 63 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
51 of 63 references.
References · 51
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
38 more
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priorscited by 156
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
- 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
- 2023Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusioncited by 50
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.