GenCOPE: Syn2Real Generalized Category-Level Object Pose Estimation for Robotic Picking
Not on the map. Why?
Abstract (arXiv)
Category-level object pose estimation (COPE), capable of generalizing to intra-class unknown objects, has become a core technique for robotic 3D scene understanding. However, existing COPE methods still require labor-intensive recollection of real-world training data for novel object categories, which limits their scalability in practical applications. This paper aims to achieve synthetic-to-real (Syn2Real) generalized COPE, where a model is trained solely on rendered synthetic data and directly generalized to real-world deployments. The central challenge lies in the significant domain gap between synthetic and real-world data, particularly in texture appearance. To address this, we aim to enhance domain generalization by learning domain-invariant representations that capture semantic commonalities among objects within the same category. We introduce 2D and 3D semantic consistency constraints to reduce the sensitivity of feature encoders to domain-specific features. In addition, we propose an end-to-end pose regression framework that performs 2D-3D cross consistency learning, leveraging dense cross-modality fusion to further refine pose estimation. Since simplicity and effectiveness are essential for real-world robotic deployment, our model operates exclusively on global features, yielding a highly lightweight and efficient architecture. Extensive experiments on the REAL275 and Wild6D benchmarks, as well as real-world robotic manipulation scenes, show superior Syn2Real generalization performance of our paradigm. Code and demos are released at https://paperreview99.github.io/GenCOPE/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 62 of its 73 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
62 of 73 references.
References · 62
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023GPT-4 Technical Reportcited by 18,132
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Mask R-CNNcited by 7,259
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2020Supervised Contrastive Learningcited by 2,803
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2015Cyclical Learning Rates for Training Neural Networkscited by 627
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
38 more
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2020Shape Prior Deformation for Categorical 6D Object Pose and Size Estimationcited by 158
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2022DeepInteraction: 3D Object Detection via Modality Interactioncited by 125
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 2021DualPoseNet: Category-level 6D Object Pose and Size Estimation Using Dual Pose Network with Refined Learning of Pose Consistencycited by 103
- 2020Category Level Object Pose Estimation via Neural Analysis-by-Synthesiscited by 100
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2019SESS: Self-Ensembling Semi-Supervised 3D Object Detectioncited by 89
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2020Few-shot 3D Point Cloud Semantic Segmentationcited by 77
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 69
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 52
- 2022HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarioscited by 51
- 2023Spectrum-guided Multi-granularity Referring Video Object Segmentationcited by 48
- 2024Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Trackingcited by 48
- 2022PhoCaL: A Multi-Modal Dataset for Category-Level Object Pose Estimation with Photometrically Challenging Objectscited by 45
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimationcited by 41
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 39
- 2023TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimationcited by 32
- 2022Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Imagecited by 29
- 2022CPPF: Towards Robust Category-Level 9D Pose Estimation in the Wildcited by 28
- 2022CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinementcited by 28
- 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimationcited by 25
- 2024DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimationcited by 24
- 2024CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledgecited by 16
- 2025Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimationcited by 16
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 16
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integrationcited by 11
50 most cited of 62 All 62 (JSON)
Built on by
Not cited yet.