mlsanityData to 14 Oct 2026

Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation

arXiv 2601.13565 ↗First posted 20 Jan 2026cs.CV cs.RO eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary 6D object pose estimation empowers robots to manipulate arbitrary unseen objects guided solely by natural language. However, a critical limitation of existing approaches is their reliance on unconstrained global matching strategies. In open-world scenarios, trying to match anchor features against the entire query image space introduces excessive ambiguity, as target features are easily confused with background distractors. To resolve this, we propose Fine-grained Correspondence Pose Estimation (FiCoP), a framework that transitions from noise-prone global matching to spatially-constrained patch-level correspondence. To systematically eliminate background interference, FiCoP first employs an object-centric disentanglement step to isolate the target from macro-level environmental noise. Building upon this localized region, our core methodological innovations are twofold. Firstly, a Cross-Perspective Global Perception (CPGP) module is proposed to fuse dual-view features, establishing structural consensus through explicit context reasoning and text-guided semantic injection. Secondly, we design a Patch Correlation Predictor (PCP) that leverages a patch-to-patch correlation matrix as a structural prior. This generates a precise block-wise association map, acting as a spatial filter to enforce fine-grained, noise-resilient matching. Experiments on the REAL275 and Toyota-Light datasets demonstrate that FiCoP improves Average Recall by 8.0% and 6.1%, respectively, compared to the state-of-the-art method, highlighting its capability to deliver robust and generalized perception for robotic agents operating in complex, unconstrained open-world environments. The source code will be made publicly available at https://github.com/zjjqinyu/FiCoP.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

24 of 31 references.

References · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  6. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
  7. 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
  8. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  9. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
  10. 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
  11. 2021PointDSC: Robust Point Cloud Registration using Deep Spatial Consistencycited by 142
  12. 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
12 more
  1. 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
  2. 2019LatentFusion: End-to-End Differentiable Reconstruction and Rendering for Unseen Object Pose Estimationcited by 89
  3. 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
  4. 2022FS6D: Few-Shot 6D Pose Estimation of Novel Objectscited by 81
  5. 2023TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimationcited by 32
  6. 2023Open-vocabulary object 6D pose estimationcited by 29
  7. 2021Vote from the Center: 6 DoF Pose Estimation in RGB-D Images by Radial Keypoint Votingcited by 25
  8. 2022Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimationcited by 22
  9. 2023Shape-Constraint Recurrent Flow for 6D Object Pose Estimationcited by 17
  10. 2022ObjectMatch: Robust Registration using Canonical Object Correspondencescited by 15
  11. 2025Co-op: Correspondence-based Novel Object Pose Estimationcited by 14
  12. 2024High-resolution open-vocabulary object 6D pose estimationcited by 10

Built on by

Not cited yet.