DeepIM: Deep Iterative Matching for 6D Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Estimating the 6D pose of objects from images is an important problem in various applications such as robot manipulation and virtual reality. While direct regression of images to object poses has limited accuracy, matching rendered images of an object against the observed image can produce accurate results. In this work, we propose a novel deep neural network for 6D pose matching named DeepIM. Given an initial pose estimation, our network is able to iteratively refine the pose by matching the rendered image against the observed image. The network is trained to predict a relative pose transformation using an untangled representation of 3D location and 3D orientation and an iterative training process. Experiments on two commonly used benchmarks for 6D pose estimation demonstrate that DeepIM achieves large improvements over state-of-the-art methods. We furthermore show that DeepIM is able to match previously unseen objects.
Key facts. Cited by 283 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 52; 2022: 76; 2023: 51; 2024: 46; 2025: 37; 2026: 21.
283 papers.
Sort:
By area:
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 113
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
38 more
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 85
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 83
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2021RePOSE: Fast 6D Object Pose Refinement via Deep Texture Renderingcited by 63
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 58
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2021Towards unconstrained joint hand-object reconstruction from RGB videoscited by 57
- 2022NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimationcited by 57
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2022Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusionscited by 54
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2022HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarioscited by 51
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021SORNet: Spatial Object-Centric Representations for Sequential Manipulationcited by 48
- 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
- 2022TAX-Pose: Task-Specific Cross-Pose Estimation for Robot Manipulationcited by 47
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 47
- 2021Wide-Depth-Range 6D Object Pose Estimation in Spacecited by 45
- 2023ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformerscited by 45
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2021Single-Stage Keypoint-Based Category-Level Object Pose Estimation from an RGB Imagecited by 42
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2021NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimationcited by 41
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2021Single-view robot pose and joint angle estimation via render & comparecited by 33
50 most cited of 283 All 283 (JSON)
- 2026Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling31 Aug 2026
- 2026A Geometry-Driven, Framework-Agnostic Optimization for Object Pose Estimation27 Aug 2026
- 2026TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers15 Aug 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bones24 Jul 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
- 2026FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows18 Jun 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systems13 May 2026
- 2026Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects7 May 2026
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
38 more
- 2026MAPRPose: Mask-Aware Proposal and Amodal Refinement for Multi-Object 6D Pose Estimation22 Apr 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation20 Mar 2026
- 2026IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v120 Mar 2026
- 2026Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements4 Mar 2026
- 2026MarUco: A Markerless 6D Pose Estimation Framework for Closed-Loop Control of Surgical Continuum Manipulators18 Feb 2026
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2026ImLoc: Revisiting Visual Localization with Image-based Representation7 Jan 2026
- 2026IDESplat: Iterative Depth Probability Estimation for Generalizable 3D Gaussian Splatting7 Jan 2026
- 2025KV-Tracker: Real-Time Pose Tracking with Transformers27 Dec 2025
- 2025AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment23 Dec 2025
- 2025Light Field Based 6DoF Tracking of Previously Unobserved Objects15 Dec 2025
- 2025GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation6 Dec 2025
- 2025WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion19 Nov 2025
- 2025iGaussian: Real-Time Camera Pose Estimation via Feed-Forward 3D Gaussian Splatting Inversion18 Nov 2025
- 2025OPFormer: Object Pose Estimation leveraging foundation model with geometric encoding16 Nov 2025
- 20256D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data14 Nov 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists23 Oct 2025
- 2025Imaginarium: Vision-guided High-Quality 3D Scene Layout Generation17 Oct 2025
- 2025MonoSE(3)-Diffusion: A Monocular SE(3) Diffusion Framework for Robust Camera-to-Robot Pose Estimation12 Oct 2025
- 2025Robust Visual Localization in Compute-Constrained Environments by Salient Edge Rendering and Weighted Hamming Similarity29 Sep 2025
- 2025Veriserum: A dual-plane fluoroscopic dataset with knee implant phantoms for deep learning in medical imaging5 Sep 2025
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System21 Aug 2025
- 2025DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects16 Aug 2025
- 2025Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes4 Aug 2025
- 2025Active Control Points-based 6DoF Pose Tracking for Industrial Metal Objects2 Jul 2025
- 2025Generating 6DoF Object Manipulation Trajectories from Action Description in Egocentric Vision4 Jun 2025
- 2025RefPose: Leveraging Reference Geometric Correspondences for Accurate 6D Pose Estimation of Unseen Objects16 May 2025
- 2025Object Pose Estimation by Camera Arm Control Based on the Next Viewpoint Estimation24 Apr 2025
- 2025Vision6D: 3D-to-2D Interactive Visualization and Annotation Tool for 6D Pose Estimation21 Apr 2025
- 2025SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow12 Apr 2025
- 2025BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation10 Apr 2025
- 2025PhysPose: Refining 6D Object Poses with Physical Constraints30 Mar 2025
- 2025Visuo-Tactile Object Pose Estimation for a Multi-Finger Robot Hand with Low-Resolution In-Hand Tactile Sensing25 Mar 2025
- 2025Co-op: Correspondence-based Novel Object Pose Estimation22 Mar 2025
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulation13 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
50 newest of 283 All 283 (JSON)
- 2023SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimationcited by 32
- 2024Object Pose Estimation via the Aggregation of Diffusion Featurescited by 12
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Modelscited by 4
- 2025MonoSE(3)-Diffusion: A Monocular SE(3) Diffusion Framework for Robust Camera-to-Robot Pose Estimationcited by 2
- 2025MonoSE(3)-Diffusion: A Monocular SE(3) Diffusion Framework for Robust Camera-to-Robot Pose Estimation12 Oct 2025
- 2024Object Pose Estimation via the Aggregation of Diffusion Features27 Mar 2024
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation19 Mar 2024
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Models5 Feb 2024
- 2023SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimation26 Oct 2023
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 198
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 155
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 120
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 113
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
12 most cited of 276 All 276 (JSON)
- 2026Lucida: Parse, Generate, and Place for Composable Real-to-Sim Scene Modeling31 Aug 2026
- 2026A Geometry-Driven, Framework-Agnostic Optimization for Object Pose Estimation27 Aug 2026
- 2026TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers15 Aug 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Learning Dense 2D-3D Correspondence for X-ray-to-CT Registration of Knee Bones24 Jul 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
- 2026FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows18 Jun 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026Twincher: Bijective Representation Learning for Robust Inversion of Continuous Systems13 May 2026
- 2026Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects7 May 2026
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
12 newest of 276 All 276 (JSON)