UnCommon Objects in 3D
Not on the map. Why?
Abstract (arXiv)
We introduce Uncommon Objects in 3D (uCO3D), a new object-centric dataset for 3D deep learning and 3D generative AI. uCO3D is the largest publicly-available collection of high-resolution videos of objects with 3D annotations that ensures full-360circ coverage. uCO3D is significantly more diverse than MVImgNet and CO3Dv2, covering more than 1,000 object categories. It is also of higher quality, due to extensive quality checks of both the collected videos and the 3D annotations. Similar to analogous datasets, uCO3D contains annotations for 3D camera poses, depth maps and sparse point clouds. In addition, each object is equipped with a caption and a 3D Gaussian Splat reconstruction. We train several large 3D models on MVImgNet, CO3Dv2, and uCO3D and obtain superior results using the latter, showing that uCO3D is better for learning applications.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 60 of its 75 references that are in the map. First posted on arXiv 13 Jan 2025.
Builds on
60 of 75 references.
References · 60
- 2017Attention Is All You Needcited by 60,361
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
38 more
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 218
- 2023Scalable 3D Captioning with Pretrained Modelscited by 203
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 167
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2025: 7; 2026: 10.
17 papers.
Sort:
By area:
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
- 2025SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splattingcited by 15
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimizationcited by 9
- 2025Scaling Sequence-to-Sequence Generative Neural Renderingcited by 8
- 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Datacited by 3
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generationcited by 1
- 2026ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illuminationcited by 1
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Renderingcited by 1
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Videocited by 0
- 2026MV-SAM: Multi-view Promptable Segmentation using Pointmap Guidancecited by 0
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objectscited by 0
5 more
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Videocited by 0
- 2026Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matchingcited by 0
- 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Contentcited by 0
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videoscited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Modelcited by 0
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Content13 Jun 2026
- 2026Eliciting Complex Spatial Reasoning in MLLMs through Wide-Baseline Matching2 Jun 2026
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video29 May 2026
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects27 May 2026
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Rendering30 Apr 2026
- 2026ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination20 Mar 2026
- 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Data19 Mar 2026
- 2026MV-SAM: Multi-view Promptable Segmentation using Pointmap Guidance25 Jan 2026
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video13 Dec 2025
- 2025Scaling Sequence-to-Sequence Generative Neural Rendering5 Oct 2025
5 more
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generation28 Aug 2025
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization20 Aug 2025
- 2025SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting10 Jun 2025
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generation21 Apr 2025
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Models6 Mar 2025
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
- 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 15
- 2025SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splattingcited by 15
- 2025Scaling Sequence-to-Sequence Generative Neural Renderingcited by 8
- 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Datacited by 3
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generationcited by 1
- 2026ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illuminationcited by 1
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Renderingcited by 1
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Videocited by 0
- 2026MV-SAM: Multi-view Promptable Segmentation using Pointmap Guidancecited by 0
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objectscited by 0
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Videocited by 0
12 most cited of 15 All 15 (JSON)
- 2026GAPrompt++: Multi-Granular Geometry-Aware Point Cloud Prompt for 3D Vision Model17 Sep 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Content13 Jun 2026
- 2026RayDer: Scalable Self-Supervised Novel View Synthesis from Real-World Video29 May 2026
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects27 May 2026
- 2026Fake3DGS: A Benchmark for 3D Manipulation Detection in Neural Rendering30 Apr 2026
- 2026ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination20 Mar 2026
- 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Data19 Mar 2026
- 2026MV-SAM: Multi-view Promptable Segmentation using Pointmap Guidance25 Jan 2026
- 2025Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video13 Dec 2025
- 2025Scaling Sequence-to-Sequence Generative Neural Rendering5 Oct 2025
- 2025Droplet3D: Commonsense Priors from Videos Facilitate 3D Generation28 Aug 2025
12 newest of 15 All 15 (JSON)