Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotations
Not on the map. Why?
Abstract (arXiv)
3D object detection has recently become popular due to many applications in robotics, augmented reality, autonomy, and image retrieval. We introduce the Objectron dataset to advance the state of the art in 3D object detection and foster new research and applications, such as 3D object tracking, view synthesis, and improved 3D shape representation. The dataset contains object-centric short videos with pose annotations for nine categories and includes 4 million annotated images in 14,819 annotated videos. We also propose a new evaluation metric, 3D Intersection over Union, for 3D object detection. We demonstrate the usefulness of our dataset in 3D object detection tasks by providing baseline models trained on this dataset. Our dataset and evaluation source code are available online at http://www.objectron.dev
Key facts. Cited by 155 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 36; 2023: 31; 2024: 24; 2025: 24; 2026: 29.
155 papers.
Sort:
By area:
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
38 more
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2025Visual Spatial Tuningcited by 85
- 2022Perspective Fields for Single Image Camera Calibrationcited by 75
- 2022Benchmarking and Analyzing Point Cloud Classification under Corruptionscited by 70
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2024CameraHMR: Aligning People with Perspectivecited by 64
- 2024Advances in 3D Generation: A Surveycited by 62
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2023NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotationscited by 53
- 2022HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarioscited by 51
- 2022ViewFool: Evaluating the Robustness of Visual Recognition to Adversarial Viewpointscited by 48
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2023HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructionscited by 47
- 2021Single-Stage Keypoint-Based Category-Level Object Pose Estimation from an RGB Imagecited by 42
- 2023EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingcited by 39
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022Transframer: Arbitrary Frame Prediction with Generative Modelscited by 37
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2023LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFscited by 33
- 2023TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimationcited by 32
- 2025Detect Anything 3D in the Wildcited by 32
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2024Language-Image Models with 3D Understandingcited by 31
- 2023POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Referencecited by 30
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
- 2022Common Pets in 3D: Dynamic New-View Synthesis of Real-Life Deformable Categoriescited by 29
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2024ImageNet3D: Towards General-Purpose Object-Level 3D Understandingcited by 25
- 2022Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wildcited by 22
- 2024OmniNOCS: A unified NOCS dataset and model for 3D lifting of 2D objectscited by 22
- 2024Open Vocabulary Monocular 3D Object Detectioncited by 22
- 2026Orient Anything V2: Unifying Orientation and Rotation Understandingcited by 22
- 2021Monocular 3D Vehicle Detection Using Uncalibrated Traffic Cameras through Homographycited by 21
- 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulationscited by 21
50 most cited of 155 All 155 (JSON)
- 2026LeRF: Learning Reference Coordinate Frames for Perspective Taking Reasoning28 Sep 2026
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models27 Sep 2026
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videos4 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation24 Aug 2026
- 2026PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes16 Aug 2026
- 2026SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment16 Jul 2026
- 2026WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis30 Jun 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026Ill-Posed by Design: Probing Evidence Use in VLMs23 Jun 2026
- 2026WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife19 Jun 2026
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easy18 Jun 2026
38 more
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026Grounded 3D-Aware Spatial Vision-Language Modeling28 May 2026
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects27 May 2026
- 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching27 Apr 2026
- 2026WildDet3D: Scaling Promptable 3D Detection in the Wild9 Apr 2026
- 2026PhyEdit: Towards Real-World Object Manipulation via Physically-Grounded Image Editing8 Apr 2026
- 2026Exploring 6D Object Pose Estimation with Deformation8 Apr 2026
- 2026Boxer: Robust Lifting of Open-World 2D Bounding Boxes to 3D6 Apr 2026
- 2026MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane20 Mar 2026
- 2026NymeriaPlus: Enriching Nymeria Dataset with Additional Annotations and Data19 Mar 2026
- 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Models17 Mar 2026
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligence5 Mar 2026
- 2026PoseVLA: Universal Pose Pretraining for Generalizable Vision-Language-Action Policies23 Feb 2026
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation10 Feb 2026
- 2026IndustryShapes: An RGB-D Benchmark dataset for 6D object pose estimation of industrial assembly components and tools5 Feb 2026
- 2026Orient Anything V2: Unifying Orientation and Rotation Understanding9 Jan 2026
- 2026LabelAny3D: Label Any Object 3D in the Wild4 Jan 2026
- 20254DLangVGGT: 4D Language-Visual Geometry Grounded Transformer4 Dec 2025
- 2025UAV-MM3D: A Large-Scale Synthetic Benchmark for 3D Perception of Unmanned Aerial Vehicles with Multi-Modal Data27 Nov 2025
- 2025LocateAnything3D: Vision-Language 3D Detection with Chain-of-Sight25 Nov 2025
- 2025LAA3D: A Benchmark of Detecting and Tracking Low-Altitude Aircraft in 3D Space24 Nov 2025
- 2025DetAny4D: Detect Anything 4D Temporally in a Streaming RGB Video24 Nov 2025
- 2025SceneDesigner: Controllable Multi-Object Image Generation with 9-DoF Pose Manipulation20 Nov 2025
- 2025Visual Spatial Tuning7 Nov 2025
- 2025Neural USD: An object-centric framework for iterative editing and control28 Oct 2025
- 2025Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists23 Oct 2025
- 2025MultiCOIN: Multi-Modal COntrollable Video INbetweening9 Oct 2025
- 20253D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detection31 Jul 2025
- 2025Boosting Multi-View Indoor 3D Object Detection via Adaptive 3D Volume Construction24 Jul 2025
- 2025BlenderFusion: 3D-Grounded Visual Editing and Generative Compositing20 Jun 2025
- 2025Aligning Text, Images, and 3D Structure Token-by-Token9 Jun 2025
- 2025Unfolding Spatial Cognition: Evaluating Multimodal Models on Visual Simulations5 Jun 2025
- 2025Marginalized Generalized IoU (MGIoU): A Unified Objective Function for Optimizing Any Convex Parametric Shapes23 Apr 2025
- 2025GATE3D: Generalized Attention-based Task-synergized Estimation in 3D*15 Apr 2025
- 2025Detect Anything 3D in the Wild10 Apr 2025
- 2025OpenLex3D: A Tiered Evaluation Benchmark for Open-Vocabulary 3D Scene Representations25 Mar 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2025MVIP -- A Dataset and Methods for Application Oriented Multi-View and Multi-Modal Industrial Part Recognition21 Feb 2025
50 newest of 155 All 155 (JSON)
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Modelscited by 30
- 2024Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimationcited by 10
- 2024DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generationcited by 9
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibrationcited by 7
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generationcited by 0
- 2026PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenescited by 0
- 2026PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes16 Aug 2026
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2024Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration26 Nov 2024
- 2024Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models13 Jun 2024
- 2024DiffCalib: Reformulating Monocular Camera Calibration as Diffusion-Based Dense Incident Map Generation24 May 2024
- 2024Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimation21 Mar 2024
- 2024Language-Image Models with 3D Understandingcited by 31
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligencecited by 7
- 2026Ill-Posed by Design: Probing Evidence Use in VLMscited by 2
- 2026Grounded 3D-Aware Spatial Vision-Language Modelingcited by 1
- 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Modelscited by 0
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Modelscited by 0
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models27 Sep 2026
- 2026Ill-Posed by Design: Probing Evidence Use in VLMs23 Jun 2026
- 2026Grounded 3D-Aware Spatial Vision-Language Modeling28 May 2026
- 2026PhysQuantAgent: An Inference Pipeline of Mass Estimation for Vision-Language Models17 Mar 2026
- 2026On the Generalization Capacities of MLLMs for Spatial Intelligence5 Mar 2026
- 2024Language-Image Models with 3D Understanding6 May 2024
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Actioncited by 301
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2022Omni3D: A Large Benchmark and Model for 3D Object Detection in the Wildcited by 159
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
12 most cited of 139 All 139 (JSON)
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videos4 Sep 2026
- 2026Revisiting Cross-View Completion: Self-Supervised Pre-Training via Reconstruction Error Comparison1 Sep 2026
- 2026Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation24 Aug 2026
- 2026SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment16 Jul 2026
- 2026WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis30 Jun 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026WildBox: A Dataset and Benchmark for Aerial Monocular 3D Detection of African Savanna Wildlife19 Jun 2026
- 2026Thinking in Boxes: 3D Editing in Real Images Made Easy18 Jun 2026
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026Every9D-21M: Large-Scale Real-World 9D Canonicalization of Everyday Objects27 May 2026
- 2026ShapeY: A Principled Framework for Measuring Shape Recognition Capacity via Nearest-Neighbor Matching27 Apr 2026
- 2026WildDet3D: Scaling Promptable 3D Detection in the Wild9 Apr 2026
12 newest of 139 All 139 (JSON)