PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Estimating the 6D pose of known objects is important for robots to interact with the real world. The problem is challenging due to the variety of objects as well as the complexity of a scene caused by clutter and occlusions between objects. In this work, we introduce PoseCNN, a new Convolutional Neural Network for 6D object pose estimation. PoseCNN estimates the 3D translation of an object by localizing its center in the image and predicting its distance from the camera. The 3D rotation of the object is estimated by regressing to a quaternion representation. We also introduce a novel loss function that enables PoseCNN to handle symmetric objects. In addition, we contribute a large scale video dataset for 6D object pose estimation named the YCB-Video dataset. Our dataset provides accurate 6D poses of 21 objects from the YCB dataset observed in 92 videos with 133,827 frames. We conduct extensive experiments on our YCB-Video dataset and the OccludedLINEMOD dataset to show that PoseCNN is highly robust to occlusions, can handle symmetric objects, and provide accurate pose estimation using only color images as input. When using depth data to further refine the poses, our approach achieves state-of-the-art results on the challenging OccludedLINEMOD dataset. Our code and dataset are available at https://rse-lab.cs.washington.edu/projects/posecnn/.
Key facts. Cited by 768 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 106; 2022: 172; 2023: 150; 2024: 116; 2025: 137; 2026: 86.
768 papers.
Sort:
By area:
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 194
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
38 more
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Modelscited by 155
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2021Keypoint Transformer: Solving Joint Identification in Challenging Hands and Object Interactions for Accurate 3D Pose Estimationcited by 122
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 116
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 115
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 115
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 114
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 113
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 88
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2023CNOS: A Strong Baseline for CAD-based Novel Object Segmentationcited by 86
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 85
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 84
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2023OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Datacited by 81
- 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
50 most cited of 768 All 768 (JSON)
- 2026Fast Pose Tracking of Rigid Objects with Compact Pose Graph Optimization8 Oct 2026
- 2026Curating Synthetic Data for Task-Specific Visual Perception29 Sep 2026
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models27 Sep 2026
- 2026Vision-Based 6-DoF Grasp Pose Estimation for Robot Cloth Unfolding25 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction20 Sep 2026
- 2026HAT: Hypothesis-Anchored Tracking for Video Monocular Spacecraft Pose Estimation18 Sep 2026
- 2026Prior-free relative 6D pose estimation of multiple object instances8 Sep 2026
- 2026Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features6 Sep 2026
- 2026CLON: Cue-Calibrated Linguistic Object Onboarding for Zero-Shot 6D Pose Front-Ends4 Sep 2026
- 2026Learning Manipulation-Sufficient Representations via Outcome Bottlenecks2 Sep 2026
- 2026Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling31 Aug 2026
38 more
- 2026When 3D Gaussian Splatting Recovers Real Surfaces30 Aug 2026
- 2026Foundational feature fusion for conditional flow matching in 6D pose estimation29 Aug 2026
- 2026A Geometry-Driven, Framework-Agnostic Optimization for Object Pose Estimation27 Aug 2026
- 2026TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers15 Aug 2026
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026Moving6DPoSe: A Multimodal Database for Monocular 6D Pose Estimation and Segmentation of Moving Objects9 Aug 2026
- 2026GOPI: Generation-Oriented 3D Pose Inference for Furniture Insertion from Single-View RGB-D Indoor Scenes7 Aug 2026
- 2026Detecting Pose Estimation Failures via Keypoint Self-Consistency4 Aug 2026
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer30 Jul 2026
- 2026SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them30 Jul 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Robust PnP on a Neuromorphic Processor for Object Pose Estimation18 Jul 2026
- 2026MotionForesight: Re-purposing Video Models for Future 3D Scene-Flow Prediction17 Jul 2026
- 2026PIXIE: A Zero-Shot texture-invariant 6D pose estimation framework for unseen objects with assembly defects17 Jul 2026
- 2026UniPose9D: Universal Category-Agnostic Object Pose Estimation10 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026GraspIT: A Dataset Bridging the Sim-to-Real gap and back for Validated Grasping SE(3) Pose Generation7 Jul 2026
- 2026GAP-GDRNet: Geometry-aware monocular 6D pose estimation for spacecraft using synthetic geometric supervision2 Jul 2026
- 2026FalconTrack: Photorealistic Auto-Labeled Perception and Physics-Aware Vision-Based Aerial Tracking29 Jun 2026
- 2026GPU-Accelerated Inverse Structural Anastylosis from Block Collapse Dynamics23 Jun 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026Unsupervised Domain Adaptation for Sim-to-Real Object Pose Estimation with Contrastive Alignment and Pseudo-Label Refinement19 Jun 2026
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026V2P-Manip: Learning Dexterous Manipulation from Monocular Human Videos15 Jun 2026
- 2026Leveraging Deep Learning for Object and Position Recognition of Load Carriers for Autonomous Logistics Vehicles14 Jun 2026
- 2026Precision-Aware Illumination-Disentangled Vision Transformer for Spacecraft 6D Pose Estimation10 Jun 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories6 Jun 2026
- 2026Learning Action-Conditional and Object-Centric Gaussian Splatting World Models for Rigid Objects1 Jun 2026
- 2026RDGen: Demonstration Generation for High-Quality Robot Learning via Reinforcement Learning29 May 2026
- 2026Object Pose and Shape Estimation for Grasping: Does it Work?26 May 2026
- 2026RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026Imaging Hidden Objects with Consumer LiDAR via Motion Induced Sampling18 May 2026
- 2026OCH3R: Object-Centric Holistic 3D Reconstruction13 May 2026
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
50 newest of 768 All 768 (JSON)
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2023A General Protocol to Probe Large Vision Models for 3D Physical Understandingcited by 32
- 2023SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimationcited by 32
- 2024Language-driven Grasp Detectioncited by 26
- 2022DALL-E for Detection: Language-driven Compositional Image Synthesis for Object Detectioncited by 17
- 2023Beyond Generation: Harnessing Text to Image Models for Object Detection and Segmentationcited by 10
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 2024Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimationcited by 10
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2023Sim2Real Bilevel Adaptation for Object Surface Classification using Vision-Based Tactile Sensorscited by 4
- 2025HIPPo: Harnessing Image-to-3D Priors for Model-free Zero-shot 6D Pose Estimationcited by 4
- 2025Conditional Latent Diffusion Models for Zero-Shot Instance Segmentationcited by 4
12 most cited of 21 All 21 (JSON)
- 2026Foundational feature fusion for conditional flow matching in 6D pose estimation29 Aug 2026
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch10 Apr 2026
- 2026TORA: Topological Representation Alignment for 3D Shape Assembly5 Apr 2026
- 2026Generative 6D Pose Estimation via Conditional Flow Matching23 Feb 2026
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation21 Aug 2025
- 2025Conditional Latent Diffusion Models for Zero-Shot Instance Segmentation6 Aug 2025
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2025HIPPo: Harnessing Image-to-3D Priors for Model-free Zero-shot 6D Pose Estimation14 Feb 2025
- 2024Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors12 Oct 2024
12 newest of 21 All 21 (JSON)
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Modelscited by 155
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Taskcited by 1
- 2025VFM-VLM: Vision Foundation Model and Vision Language Model based Visual Comparison for 3D Pose Estimationcited by 0
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurementcited by 0
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectoriescited by 0
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Modelscited by 0
- 2026Toward Comprehensive 3D Grounding: Orientation Grounding through Vision-Language Models27 Sep 2026
- 2026EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories6 Jun 2026
- 2026Do Foundation Models Know Geometry? Probing Frozen Features for Continuous Physical Measurement6 Mar 2026
- 2025VFM-VLM: Vision Foundation Model and Vision Language Model based Visual Comparison for 3D Pose Estimation8 Dec 2025
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun 2024
- 2024HPE-CogVLM: Advancing Vision Language Models with a Head Pose Grounding Task4 Jun 2024
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Models2 Mar 2023
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2021Accuracy on the Line: On the Strong Correlation Between Out-of-Distribution and In-Distribution Generalizationcited by 248
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 161
12 most cited of 729 All 729 (JSON)
- 2026Fast Pose Tracking of Rigid Objects with Compact Pose Graph Optimization8 Oct 2026
- 2026Curating Synthetic Data for Task-Specific Visual Perception29 Sep 2026
- 2026Vision-Based 6-DoF Grasp Pose Estimation for Robot Cloth Unfolding25 Sep 2026
- 2026PICO: Projection-Informed Consistency Optimisation for 6DoF Surgical Tool Pose Estimation25 Sep 2026
- 2026Mira-Scene: Pixel-Aligned Layouts for Generative 3D Scene Reconstruction20 Sep 2026
- 2026HAT: Hypothesis-Anchored Tracking for Video Monocular Spacecraft Pose Estimation18 Sep 2026
- 2026Prior-free relative 6D pose estimation of multiple object instances8 Sep 2026
- 2026Back to the Feature: Zero-Shot 6DoF Pose Estimation via Dense Local Features6 Sep 2026
- 2026CLON: Cue-Calibrated Linguistic Object Onboarding for Zero-Shot 6D Pose Front-Ends4 Sep 2026
- 2026Learning Manipulation-Sufficient Representations via Outcome Bottlenecks2 Sep 2026
- 2026Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling31 Aug 2026
- 2026When 3D Gaussian Splatting Recovers Real Surfaces30 Aug 2026
12 newest of 729 All 729 (JSON)