6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints
Not on the map. Why?
Abstract (arXiv)
We present 6-PACK, a deep learning approach to category-level 6D object pose tracking on RGB-D data. Our method tracks in real-time novel object instances of known object categories such as bowls, laptops, and mugs. 6-PACK learns to compactly represent an object by a handful of 3D keypoints, based on which the interframe motion of an object instance can be estimated through keypoint matching. These keypoints are learned end-to-end without manual supervision in order to be most effective for tracking. Our experiments show that our method substantially outperforms existing methods on the NOCS category-level 6D pose estimation benchmark and supports a physical robot to perform simple vision-based closed-loop manipulation tasks. Our code and video are available at https://sites.google.com/view/6packtracking.
Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 15; 2022: 27; 2023: 16; 2024: 6; 2025: 8; 2026: 6.
78 papers.
Sort:
By area:
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 20213D Neural Scene Representations for Visuomotor Controlcited by 111
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 86
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 72
38 more
- 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 70
- 2021Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networkscited by 69
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimationcited by 49
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
- 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representationscited by 45
- 2022Neural Shape Mating: Self-Supervised Object Assembly with Adversarial Shape Priorscited by 43
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimationcited by 43
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimationcited by 41
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 41
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 2022Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objectscited by 30
- 2022CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinementcited by 29
- 2022USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulationcited by 27
- 2021iCaps: Iterative Category-level Object Pose and Shape Estimationcited by 23
- 2022Keypoint-Based Category-Level Object Pose Tracking from an RGB Sequence with Uncertainty Estimationcited by 19
- 2022Generative Category-Level Shape and Pose Estimation with Semantic Primitivescited by 19
- 2021Orienting Novel 3D Objects Using Self-Supervised Learning of Rotation Transformscited by 17
- 2021Co-GAIL: Learning Diverse Strategies for Human-Robot Collaborationcited by 17
- 2021Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Spacecited by 17
- 2022Fusing Local Similarities for Retrieval-based 3D Orientation Estimation of Unseen Objectscited by 17
- 2022Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wildcited by 17
- 2023A Universal Semantic-Geometric Representation for Robotic Manipulationcited by 16
- 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Trackingcited by 15
- 2023SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variationscited by 13
- 2021Learning Perceptual Concepts by Bootstrapping from Human Queriescited by 12
- 2023PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environmentscited by 11
- 2024Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimationcited by 11
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splattingcited by 11
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Trackingcited by 10
- 2023You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Examplecited by 8
- 2022Semantic keypoint-based pose estimation from single RGB framescited by 7
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypointscited by 7
- 2023Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objectscited by 6
50 most cited of 78 All 78 (JSON)
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition10 Jul 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026RigidFormer: Learning Rigid Dynamics using Transformers9 May 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation5 Feb 2026
- 2025Light Field Based 6DoF Tracking of Previously Unobserved Objects15 Dec 2025
- 2025PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning11 Dec 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices28 Sep 2025
- 2025FUNCanon: Learning Pose-Aware Action Primitives via Functional Object Canonicalization for Generalizable Robotic Manipulation23 Sep 2025
- 2025DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects16 Aug 2025
38 more
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Tracking8 Jun 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting2 Dec 2024
- 2024OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB9 Oct 2024
- 2024Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation26 Sep 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Category-Agnostic Pose Estimation for Point Clouds12 Mar 2024
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker9 Jan 2024
- 2023PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environments23 Dec 2023
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects13 Dec 2023
- 2023ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map18 Oct 2023
- 2023SA6D: Self-Adaptive Few-Shot 6D Pose Estimator for Novel and Occluded Objects31 Aug 2023
- 2023MV-ROPE: Multi-view Constraints for Robust Category-level Object Pose and Size Estimation17 Aug 2023
- 2023Grasp Transfer based on Self-Aligning Implicit Representations of Local Surfaces15 Aug 2023
- 2023Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objects28 Jun 2023
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2023A Universal Semantic-Geometric Representation for Robotic Manipulation18 Jun 2023
- 2023Counter-Hypothetical Particle Filters for Single Object Pose Tracking28 May 2023
- 2023You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example22 May 2023
- 2023HS-Pose: Hybrid Scope Feature Extraction for Category-level Object Pose Estimation28 Mar 2023
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects24 Mar 2023
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformation23 Mar 2023
- 2023SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations18 Mar 2023
- 2023RGB-D-Based Categorical Object Pose and Shape Estimation: Methods, Datasets, and Evaluation19 Jan 2023
- 2022Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representation9 Dec 2022
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts10 Nov 2022
- 2022Visual Reinforcement Learning with Self-Supervised 3D Representations13 Oct 2022
- 2022Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensing8 Oct 2022
- 2022Generative Category-Level Shape and Pose Estimation with Semantic Primitives3 Oct 2022
- 2022USEEK: Unsupervised SE(3)-Equivariant 3D Keypoints for Generalizable Manipulation28 Sep 2022
- 2022Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild24 Sep 2022
- 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Tracking15 Sep 2022
- 2022SSP-Pose: Symmetry-Aware Shape Prior Deformation for Direct Category-Level Object Pose Estimation13 Aug 2022
- 2022RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation30 Jul 2022
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization27 Jul 2022
- 2022CATRE: Iterative Point Clouds Alignment for Category-level Object Pose Refinement17 Jul 2022
- 2022Optimal and Robust Category-level Perception: Object Pose and Shape Estimation from 2D and 3D Semantic Keypoints24 Jun 2022
- 2022Category-Agnostic 6D Pose Estimation with Conditional Neural Processes14 Jun 2022
50 newest of 78 All 78 (JSON)
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2021FS-Net: Fast Shape-based Network for Category-Level 6D Object Pose Estimation with Decoupled Rotation Mechanismcited by 121
- 20213D Neural Scene Representations for Visuomotor Controlcited by 111
- 2022GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Votingcited by 94
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 86
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 72
12 most cited of 76 All 76 (JSON)
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition10 Jul 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026RigidFormer: Learning Rigid Dynamics using Transformers9 May 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2025Light Field Based 6DoF Tracking of Previously Unobserved Objects15 Dec 2025
- 2025PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning11 Dec 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices28 Sep 2025
- 2025FUNCanon: Learning Pose-Aware Action Primitives via Functional Object Canonicalization for Generalizable Robotic Manipulation23 Sep 2025
- 2025DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects16 Aug 2025
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Tracking8 Jun 2025
12 newest of 76 All 76 (JSON)