Cue3D: Quantifying the Role of Image Cues in Single-Image 3D Generation
Not on the map. Why?
Abstract (arXiv)
Humans and traditional computer vision methods rely on a diverse set of monocular cues to infer 3D structure from a single image, such as shading, texture, silhouette, etc. While recent deep generative models have dramatically advanced single-image 3D generation, it remains unclear which image cues these methods actually exploit. We introduce Cue3D, the first comprehensive, model-agnostic framework for quantifying the influence of individual image cues in single-image 3D generation. Our unified benchmark evaluates seven state-of-the-art methods, spanning regression-based, multi-view, and native 3D generative paradigms. By systematically perturbing cues such as shading, texture, silhouette, perspective, edges, and local continuity, we measure their impact on 3D output quality. Our analysis reveals that shape meaningfulness, not texture, dictates generalization. Geometric cues, particularly shading, are crucial for 3D generation. We further identify over-reliance on provided silhouettes and diverse sensitivities to cues such as perspective and local continuity across model families. By dissecting these dependencies, Cue3D advances our understanding of how modern 3D networks leverage classical vision cues, and offers directions for developing more transparent, robust, and controllable single-image 3D generation models.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 62 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
36 of 62 references.
References · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
24 more
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2015Holistically-Nested Edge Detectioncited by 590
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
- 2024Probing the 3D Awareness of Visual Foundation Modelscited by 175
- 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
- 2021NeRF-VAE: A Geometry Aware 3D Scene Generative Modelcited by 111
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
- 2022Learning to generate line drawings that convey geometry and semanticscited by 82
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
- 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
- 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
- 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
- 2024Lightweight Pixel Difference Networks for Efficient Visual Representation Learningcited by 17
- 2024Evaluating Multiview Object Consistency in Humans and Image Modelscited by 12
- 2024Symmetry Strikes Back: From Single-Image Symmetry Detection to 3D Generationcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.