mlsanityData to 14 Oct 2026

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling

arXiv 1804.04610 ↗First posted 12 Apr 2018cs.CV cs.LGcited by 218

Not on the map. Why?

Cited by 20 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We study 3D shape modeling from a single image and make contributions to it in three aspects. First, we present Pix3D, a large-scale benchmark of diverse image-shape pairs with pixel-level 2D-3D alignment. Pix3D has wide applications in shape-related tasks including reconstruction, retrieval, viewpoint estimation, etc. Building such a large-scale dataset, however, is highly challenging; existing datasets either contain only synthetic data, or lack precise alignment between 2D images and 3D shapes, or only have a small number of images. Second, we calibrate the evaluation criteria for 3D shape reconstruction through behavioral studies, and use them to objectively and systematically benchmark cutting-edge reconstruction algorithms on Pix3D. Third, we design a novel model that simultaneously performs 3D reconstruction and pose estimation; our multi-task learning approach achieves state-of-the-art performance on both tasks.

Key facts. Cited by 218 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 41; 2022: 40; 2023: 53; 2024: 44; 2025: 22; 2026: 18.

218 papers.

Sort:

By area:

  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  2. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  3. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  4. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  5. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  6. 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 249
  7. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  8. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  9. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  10. 2023Scalable 3D Captioning with Pretrained Modelscited by 203
  11. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  12. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
38 more
  1. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  2. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  3. 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
  4. 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
  5. 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
  6. 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
  7. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
  8. 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
  9. 2022ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfercited by 75
  10. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  11. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  12. 2024Advances in 3D Generation: A Surveycited by 63
  13. 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
  14. 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 44
  15. 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 42
  16. 2023The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objectscited by 41
  17. 2021Deep Implicit Surface Point Prediction Networkscited by 40
  18. 2021Patch2CAD: Patchwise Embedding Learning for In-the-Wild Shape Retrieval from a Single Imagecited by 39
  19. 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
  20. 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
  21. 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 35
  22. 2024Zero-Shot Scene Reconstruction from Single Images with Deep Prior Assemblycited by 35
  23. 2021Active 3D Shape Reconstruction from Vision and Touchcited by 34
  24. 2022Learning to Imitate Object Interactions from Internet Videoscited by 34
  25. 2024A survey of synthetic data augmentation methods in computer visioncited by 34
  26. 2021DSP-SLAM: Object Oriented SLAM with Deep Shape Priorscited by 30
  27. 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
  28. 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstructioncited by 29
  29. 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 28
  30. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 27
  31. 2021LegoFormer: Transformers for Block-by-Block Multi-view 3D Reconstructioncited by 25
  32. 20233DQD: Generalized Deep 3D Shape Prior via Part-Discretized Diffusion Processcited by 25
  33. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  34. 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
  35. 2022Interactive Object Segmentation in 3D Point Cloudscited by 23
  36. 2025DepR: Depth Guided Single-view Scene Reconstruction with Instance-level Diffusioncited by 23
  37. 2023IKEA-Manual: Seeing Shape Assembly Step by Stepcited by 22
  38. 2024OmniNOCS: A unified NOCS dataset and model for 3D lifting of 2D objectscited by 22

50 most cited of 218 All 218 (JSON)