Fusing Local Similarities for Retrieval-based 3D Orientation Estimation of Unseen Objects
Not on the map. Why?
Abstract (arXiv)
In this paper, we tackle the task of estimating the 3D orientation of previously-unseen objects from monocular images. This task contrasts with the one considered by most existing deep learning methods which typically assume that the testing objects have been observed during training. To handle the unseen objects, we follow a retrieval-based strategy and prevent the network from learning object-specific features by computing multi-scale local similarities between the query image and synthetically-generated reference images. We then introduce an adaptive fusion module that robustly aggregates the local similarities into a global similarity score of pairwise images. Furthermore, we speed up the retrieval process by developing a fast retrieval strategy. Our experiments on the LineMOD, LineMOD-Occluded, and T-LESS datasets show that our method yields a significantly better generalization to unseen objects than previous works. Our code and pre-trained models are available at https://sailor-z.github.io/projects/Unseen_Object_Pose.html.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 29 of its 42 references that are in the map. First posted on arXiv 16 Mar 2022.
Builds on
29 of 42 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2016Multi-View 3D Object Detection Network for Autonomous Drivingcited by 724
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
17 more
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 241
- 2022Generalized Category Discoverycited by 211
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2019Category-Level Articulated Object Pose Estimationcited by 159
- 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 153
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2019LatentFusion: End-to-End Differentiable Reconstruction and Rendering for Unseen Object Pose Estimationcited by 89
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2019Pose from Shape: Deep Pose Estimation for Arbitrary 3D Objectscited by 39
- 2021PoseContrast: Class-Agnostic Object Viewpoint Estimation in the Wild with Pose-Aware Contrastive Learningcited by 19
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 7; 2025: 3; 2026: 1.
17 papers.
Sort:
By area:
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 114
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 2024Object Pose Estimation via the Aggregation of Diffusion Featurescited by 12
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 20233D-Aware Hypothesis & Verification for Generalizable Relative Object Pose Estimationcited by 11
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimationcited by 10
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulationcited by 10
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimationcited by 9
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Modelscited by 4
5 more
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Cameracited by 2
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matchingcited by 1
- 2024DVMNet++: Rethinking Relative Pose Estimation for Unseen Objectscited by 0
- 2025Eff-GRot: Efficient and Generalizable Rotation Estimation with Transformerscited by 0
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimationcited by 0
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2025Eff-GRot: Efficient and Generalizable Rotation Estimation with Transformers21 Dec 2025
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Camera26 Mar 2025
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulation13 Mar 2025
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching24 Nov 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Object Pose Estimation via the Aggregation of Diffusion Features27 Mar 2024
- 2024DVMNet++: Rethinking Relative Pose Estimation for Unseen Objects20 Mar 2024
- 2024OV9D: Open-Vocabulary Category-Level 9D Object Pose and Size Estimation19 Mar 2024
- 2024Extreme Two-View Geometry From Object Poses with Diffusion Models5 Feb 2024
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence23 Nov 2023
5 more
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence23 Nov 2023
- 20233D-Aware Hypothesis & Verification for Generalizable Relative Object Pose Estimation5 Oct 2023
- 2023NOPE: Novel Object Pose Estimation from a Single Image23 Mar 2023
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimation29 Nov 2022
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images22 Apr 2022
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondencecited by 114
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2023NOPE: Novel Object Pose Estimation from a Single Imagecited by 38
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondencecited by 12
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Imagecited by 12
- 20233D-Aware Hypothesis & Verification for Generalizable Relative Object Pose Estimationcited by 11
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulationcited by 10
- 2022LocPoseNet: Robust Location Prior for Unseen Object Pose Estimationcited by 9
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Cameracited by 2
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matchingcited by 1
- 2024DVMNet++: Rethinking Relative Pose Estimation for Unseen Objectscited by 0
12 most cited of 14 All 14 (JSON)
- 2026MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation11 Jan 2026
- 2025Eff-GRot: Efficient and Generalizable Rotation Estimation with Transformers21 Dec 2025
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Camera26 Mar 2025
- 20256D Object Pose Tracking in Internet Videos for Robotic Manipulation13 Mar 2025
- 2024UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image25 Nov 2024
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching24 Nov 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024DVMNet++: Rethinking Relative Pose Estimation for Unseen Objects20 Mar 2024
- 2023GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence23 Nov 2023
- 2023GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence23 Nov 2023
- 20233D-Aware Hypothesis & Verification for Generalizable Relative Object Pose Estimation5 Oct 2023
- 2023NOPE: Novel Object Pose Estimation from a Single Image23 Mar 2023
12 newest of 14 All 14 (JSON)