Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a generalizable model-free 6-DoF object pose estimator called Gen6D. Existing generalizable pose estimators either need high-quality object models or require additional depth maps or object masks in test time, which significantly limits their application scope. In contrast, our pose estimator only requires some posed images of the unseen object and is able to accurately predict the poses of the object in arbitrary environments. Gen6D consists of an object detector, a viewpoint selector and a pose refiner, all of which do not require the 3D object model and can generalize to unseen objects. Experiments show that Gen6D achieves state-of-the-art results on two model-free datasets: the MOPED dataset and a new GenMOP dataset collected by us. In addition, on the LINEMOD dataset, Gen6D achieves competitive results compared with instance-specific pose estimators. Project page: https://liuyuan-pal.github.io/Gen6D/.
Key facts. Cited by 121 papers in the map (data through 14 Oct 2026). Builds on 60 of its 76 references that are in the map. First posted on arXiv 22 Apr 2022.
Builds on
60 of 76 references.
References · 60
- 2017Attention Is All You Needcited by 60,361
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
38 more
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2017Real-Time Seamless Single Shot 6D Object Pose Predictioncited by 210
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
- 2020BOP Challenge 2020 on 6D Object Localizationcited by 193
- 2019DPOD: 6D Pose Object Detector and Refinercited by 189
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 161
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 148
- 2020Few-Shot Object Detection and Viewpoint Estimation for Objects in the Wildcited by 142
- 2020Learning Canonical Shape Space for Category-Level 6D Object Pose and Size Estimationcited by 124
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 116
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2019LatentFusion: End-to-End Differentiable Reconstruction and Rendering for Unseen Object Pose Estimationcited by 89
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
- 2022OSOP: A Multi-Stage One Shot Object Pose Estimation Frameworkcited by 81
- 2020Self6D: Self-Supervised Monocular 6D Object Pose Estimationcited by 79
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2022Zero-Shot Category-Level Object Pose Estimationcited by 57
- 2022Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusionscited by 54
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2022OVE6D: Object Viewpoint Encoding for Depth-based 6D Object Pose Estimationcited by 43
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimationcited by 40
- 2019Pose from Shape: Deep Pose Estimation for Arbitrary 3D Objectscited by 39
- 2020OS2D: One-Stage One-Shot Object Detection by Matching Anchor Featurescited by 35
- 2019On Object Symmetries and 6D Pose Estimation from Imagescited by 33
- 2021ZePHyR: Zero-shot Pose Hypothesis Ratingcited by 26
- 2021iCaps: Iterative Category-level Object Pose and Shape Estimationcited by 23
- 2020I Like to Move It: 6D Pose Estimation as an Action Decision Processcited by 22
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2022: 6; 2023: 26; 2024: 29; 2025: 34; 2026: 26.
121 papers.
Sort:
By area:
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2024SpatialPIN: Enhancing Spatial Reasoning Capabilities of Vision-Language Models through Prompting and Interacting 3D Priorscited by 54
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
38 more
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 49
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrationscited by 38
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2024GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objectscited by 33
- 2023POPE: 6-DoF Promptable Pose Estimation of Any Object, in Any Scene, with One Referencecited by 30
- 2023Open-vocabulary object 6D pose estimationcited by 29
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2026Orient Anything V2: Unifying Orientation and Rotation Understandingcited by 23
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2023Learning to Estimate 6DoF Pose from Limited Data: A Few-Shot, Generalizable Approach using RGB Imagescited by 18
- 2025One2Any: One-Reference 6D Pose Estimation for Any Objectcited by 18
- 2024Adapting Pre-Trained Vision Models for Novel Instance Detection and Segmentationcited by 17
- 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Trackingcited by 15
- 2024GS-Pose: Generalizable Segmentation-based 6D Object Pose Estimation with 3D Gaussian Splattingcited by 15
- 2024Adaptive Surface Normal Constraint for Geometric Estimation from Monocular Imagescited by 14
- 2025Co-op: Correspondence-based Novel Object Pose Estimationcited by 14
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation modelscited by 13
- 2023PoseMatcher: One-shot 6D Object Pose Estimation by Deep Feature Matchingcited by 12
- 2023The Treachery of Images: Bayesian Scene Keypoints for Deep Policy Learning in Robotic Manipulationcited by 12
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 2023Diff-DOPE: Differentiable Deep Object Pose Estimationcited by 11
- 20233D-Aware Hypothesis & Verification for Generalizable Relative Object Pose Estimationcited by 11
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splattingcited by 11
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integrationcited by 11
- 2023MFOS: Model-Free & One-Shot Object Pose Estimationcited by 10
- 2024RHOBIN Challenge: Reconstruction of Human Object Interactioncited by 10
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 2024High-resolution open-vocabulary object 6D pose estimationcited by 10
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimationcited by 9
- 2025UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial Referencescited by 9
- 2023VoxDet: Voxel Learning for Novel Instance Detectioncited by 8
- 2025Zero-Shot Human-Object Interaction Synthesis with Multimodal Priorscited by 7
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observationscited by 7
- 2023SA6D: Self-Adaptive Few-Shot 6D Pose Estimator for Novel and Occluded Objectscited by 6
- 2025PicoPose: Progressive Pixel-to-Pixel Correspondence Learning for Novel Object Pose Estimationcited by 6
50 most cited of 121 All 121 (JSON)
- 2026NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement9 Oct 2026
- 2026GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking30 Sep 2026
- 2026CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Parts15 Sep 2026
- 2026Prior-free relative 6D pose estimation of multiple object instances8 Sep 2026
- 2026CLON: Cue-Calibrated Linguistic Object Onboarding for Zero-Shot 6D Pose Front-Ends4 Sep 2026
- 2026Learning to Assemble Novel Structures with Unfamiliar Parts under Semantic Constraints13 Aug 2026
- 2026PIXIE: A Zero-Shot texture-invariant 6D pose estimation framework for unseen objects with assembly defects17 Jul 2026
- 2026UniPose9D: Universal Category-Agnostic Object Pose Estimation10 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026MF-UAVPose6D: A Model-Free Monocular 6-DoF Pose Estimation Framework for Fixed-Wing UAVs29 Jun 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
38 more
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026Rotational Symmetry based Object Pose Estimation from Point Clouds in the Absence of Known 3D Models15 Jun 2026
- 2026MooMIns -- Monocular 3D Reconstruction and Object Pose Estimation from Multiple Instances12 Jun 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects7 May 2026
- 2026Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations29 Apr 2026
- 2026MAPRPose: Mask-Aware Proposal and Amodal Refinement for Multi-Object 6D Pose Estimation22 Apr 2026
- 2026HACMatch Semi-Supervised Rotation Regression with Hardness-Aware Curriculum Pseudo Labeling23 Mar 2026
- 2026From Local Matches to Global Masks: Template-Guided Instance Detection and Segmentation in Open-World Scenes3 Mar 2026
- 2026IndustryShapes: An RGB-D Benchmark dataset for 6D object pose estimation of industrial assembly components and tools5 Feb 2026
- 2026Differentiable Inverse Graphics for Zero-shot Scene Reconstruction and Robot Grasping4 Feb 2026
- 2026Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation20 Jan 2026
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2026Orient Anything V2: Unifying Orientation and Rotation Understanding9 Jan 2026
- 2025PoseStreamer: A Multi-modal Framework for 3D Tracking of Unseen Moving Objects28 Dec 2025
- 2025Eff-GRot: Efficient and Generalizable Rotation Estimation with Transformers21 Dec 2025
- 2025ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors9 Dec 2025
- 2025CC-FMO: Camera-Conditioned Zero-Shot Single Image to 3D Scene Generation with Foundation Model Orchestration29 Nov 2025
- 2025AnyBox: Efficient Zero-Shot 9DoF Pose Estimation of Boxes for Robotic Manipulation19 Nov 2025
- 2025WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion19 Nov 2025
- 2025CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation17 Nov 2025
- 2025OPFormer: Object Pose Estimation leveraging foundation model with geometric encoding16 Nov 2025
- 2025Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists23 Oct 2025
- 2025RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation21 Oct 2025
- 2025Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View13 Oct 2025
- 2025SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference26 Sep 2025
- 2025IMD: A 6-DoF Pose Estimation Benchmark for Industrial Metallic Objects15 Sep 2025
- 2025Learning Primitive Embodied World Models: Towards Scalable Robotic Learning28 Aug 2025
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation21 Aug 2025
- 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations1 Jul 2025
- 2025T-Rex: Task-Adaptive Spatial Representation Extraction for Robotic Manipulation with Vision-Language Models24 Jun 2025
- 2025Accurate and efficient zero-shot 6D pose estimation with frozen foundation models11 Jun 2025
- 2025UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References9 Jun 2025
- 2025Accelerating SfM-based Pose Estimation with Dominating Set4 Jun 2025
- 2025SR3D: Unleashing Single-view 3D Reconstruction for Transparent and Specular Object Grasping30 May 2025
- 2025GMatch: A Lightweight, Geometry-Constrained Keypoint Matcher for Zero-Shot 6DoF Pose Estimation in Robotic Grasp Tasks22 May 2025
- 2025One2Any: One-Reference 6D Pose Estimation for Any Object7 May 2025
- 2025PRISM-DP: Spatial Pose-based Observations for Diffusion-Policies via Segmentation, Mesh Generation, and Pose Tracking29 Apr 2025
50 newest of 121 All 121 (JSON)
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 2025MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Modelcited by 5
- 2025PRISM-DP: Spatial Pose-based Observations for Diffusion-Policies via Segmentation, Mesh Generation, and Pose Trackingcited by 5
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Modelscited by 4
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimationcited by 2
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generationcited by 0
- 2025UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation21 Aug 2025
- 2025PRISM-DP: Spatial Pose-based Observations for Diffusion-Policies via Segmentation, Mesh Generation, and Pose Tracking29 Apr 2025
- 2025MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model14 Apr 2025
- 2025AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation9 Mar 2025
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation19 Mar 2024
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Models5 Feb 2024
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
- 2023SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimationcited by 117
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2023FoundPose: Unseen Object Pose Estimation with Foundation Featurescited by 109
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
- 2025Any6D: Model-free 6D Pose Estimation of Novel Objectscited by 49
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
12 most cited of 111 All 111 (JSON)
- 2026NovaSplat: Model-Free 6D Object Pose Estimation via 3D Gaussian Splatting Onboarding and Refinement9 Oct 2026
- 2026GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking30 Sep 2026
- 2026CALIPER: Metric-Grounded Model-Free Recognition of Visually Similar Industrial Parts15 Sep 2026
- 2026Prior-free relative 6D pose estimation of multiple object instances8 Sep 2026
- 2026CLON: Cue-Calibrated Linguistic Object Onboarding for Zero-Shot 6D Pose Front-Ends4 Sep 2026
- 2026Learning to Assemble Novel Structures with Unfamiliar Parts under Semantic Constraints13 Aug 2026
- 2026PIXIE: A Zero-Shot texture-invariant 6D pose estimation framework for unseen objects with assembly defects17 Jul 2026
- 2026UniPose9D: Universal Category-Agnostic Object Pose Estimation10 Jul 2026
- 2026ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation7 Jul 2026
- 2026Emergence of a Shared Canonical Object Frame from In-the-Wild Videos29 Jun 2026
- 2026MF-UAVPose6D: A Model-Free Monocular 6-DoF Pose Estimation Framework for Fixed-Wing UAVs29 Jun 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
12 newest of 111 All 111 (JSON)