mlsanityData to 7 Oct 2026

OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation

arXiv 2301.07525 ↗First posted 18 Jan 2023cs.CVcited by 324

Not on the map. Why?

Cited by 60 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in modeling 3D objects mostly rely on synthetic datasets due to the lack of large-scale realscanned 3D databases. To facilitate the development of 3D perception, reconstruction, and generation in the real world, we propose OmniObject3D, a large vocabulary 3D object dataset with massive high-quality real-scanned 3D objects. OmniObject3D has several appealing properties: 1) Large Vocabulary: It comprises 6,000 scanned objects in 190 daily categories, sharing common classes with popular 2D datasets (e.g., ImageNet and LVIS), benefiting the pursuit of generalizable 3D representations. 2) Rich Annotations: Each 3D object is captured with both 2D and 3D sensors, providing textured meshes, point clouds, multiview rendered images, and multiple real-captured videos. 3) Realistic Scans: The professional scanners support highquality object scans with precise shapes and realistic appearances. With the vast exploration space offered by OmniObject3D, we carefully set up four evaluation tracks: a) robust 3D perception, b) novel-view synthesis, c) neural surface reconstruction, and d) 3D object generation. Extensive studies are performed on these four benchmarks, revealing new observations, challenges, and opportunities for future research in realistic 3D vision.

Key facts. Cited by 324 papers in the map (data through 7 Oct 2026). Builds on 95 of its 112 references that are in the map. First posted on arXiv 18 Jan 2023.

Builds on

95 of 112 references.

References · 95

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  9. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  10. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  11. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  12. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
38 more
  1. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  2. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  7. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  8. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  9. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  10. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  11. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  13. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  14. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  15. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  16. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  17. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  18. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  19. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  20. 2020PCT: Point cloud transformercited by 730
  21. 2018Open3D: A Modern Library for 3D Data Processingcited by 717
  22. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  23. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  24. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  25. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  26. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  27. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  28. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  29. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  30. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  31. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  32. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
  33. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  34. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  35. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
  36. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  37. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  38. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446

50 most cited of 95 All 95 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 37; 2024: 107; 2025: 104; 2026: 76.

324 papers.

Sort:

By area:

  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  2. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  3. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  4. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  5. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  6. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  7. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  8. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  9. 2024A Survey on 3D Gaussian Splattingcited by 221
  10. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
  11. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  12. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
38 more
  1. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  2. 2025Streaming 4D Visual Geometry Transformercited by 147
  3. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  4. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
  5. 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
  6. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  7. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  8. 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
  9. 20243D Gaussian as a New Era: A Surveycited by 102
  10. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
  11. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  12. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  13. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
  14. 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
  15. 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
  16. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  17. 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
  18. 2024Not All Noises Are Created Equally:Diffusion Noise Selection and Optimizationcited by 70
  19. 2023GPT4Point: A Unified Framework for Point-Language Understanding and Generationcited by 69
  20. 2023LEAP: Liberate Sparse-view 3D Modeling from Camera Posescited by 65
  21. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  22. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  23. 2024Advances in 3D Generation: A Surveycited by 62
  24. 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 60
  25. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  26. 2024GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splattingcited by 59
  27. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 59
  28. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  29. 2024RoboCodeX: Multimodal Code Generation for Robotic Behavior Synthesiscited by 55
  30. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  31. 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
  32. 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 53
  33. 2024AGG: Amortized Generative 3D Gaussians for Single Image to 3Dcited by 51
  34. 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
  35. 2024Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Trackingcited by 48
  36. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policycited by 46
  37. 2024GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modelingcited by 44
  38. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44

50 most cited of 324 All 324 (JSON)