PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Tracking
Not on the map. Why?
Abstract (arXiv)
Tracking 6D poses of objects from videos provides rich information to a robot in performing different tasks such as manipulation and navigation. In this work, we formulate the 6D object pose tracking problem in the Rao-Blackwellized particle filtering framework, where the 3D rotation and the 3D translation of an object are decoupled. This factorization allows our approach, called PoseRBPF, to efficiently estimate the 3D translation of an object along with the full distribution over the 3D rotation. This is achieved by discretizing the rotation space in a fine-grained manner, and training an auto-encoder network to construct a codebook of feature embeddings for the discretized rotations. As a result, PoseRBPF can track objects with arbitrary symmetries while still maintaining adequate posterior distributions. Our approach achieves state-of-the-art results on two 6D pose estimation benchmarks. A video showing the experiments can be found at https://youtu.be/lE5gjzRKWuA
Key facts. Cited by 91 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 22; 2022: 19; 2023: 16; 2024: 13; 2025: 13; 2026: 7.
91 papers.
Sort:
By area:
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2021SORNet: Spatial Object-Centric Representations for Sequential Manipulationcited by 48
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
38 more
- 2021Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overviewcited by 31
- 2022Iterative Corresponding Geometry: Fusing Region and Depth for Highly Efficient 3D Tracking of Textureless Objectscited by 30
- 2024HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interactioncited by 29
- 20213DP3: 3D Scene Perception via Probabilistic Programmingcited by 26
- 2021iCaps: Iterative Category-level Object Pose and Shape Estimationcited by 23
- 2023Challenges for Monocular 6D Object Pose Estimation in Roboticscited by 21
- 2021SRT3D: A Sparse Region-Based 3D Object Tracking Approach for the Real Worldcited by 19
- 2022Keypoint-Based Category-Level Object Pose Tracking from an RGB Sequence with Uncertainty Estimationcited by 19
- 2022Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wildcited by 17
- 2024Adapting Pre-Trained Vision Models for Novel Instance Detection and Segmentationcited by 17
- 2022Tac2Pose: Tactile Object Pose Estimation from the First Touchcited by 15
- 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Trackingcited by 15
- 2023SpyroPose: SE(3) Pyramids for Object Pose Distribution Estimationcited by 14
- 2021Learning Perceptual Concepts by Bootstrapping from Human Queriescited by 12
- 2023PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environmentscited by 11
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splattingcited by 11
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integrationcited by 11
- 2021ROFT: Real-Time Optical Flow-Aided 6D Object Pose and Velocity Trackingcited by 10
- 2023Collision-aware In-hand 6D Object Pose Estimation using Multiple Vision-based Tactile Sensorscited by 10
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Trackingcited by 10
- 2023Multi-Object Manipulation via Object-Centric Neural Scattering Functionscited by 9
- 2023SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenescited by 9
- 2024Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimationcited by 9
- 2022NARF22: Neural Articulated Radiance Fields for Configuration-Aware Renderingcited by 8
- 2023Uncertainty-aware 3D Object-Level Mapping with Deep Shape Priorscited by 8
- 2021Improving Safety in Deep Reinforcement Learning using Unsupervised Action Planningcited by 7
- 2022Large-displacement 3D Object Tracking with Hybrid Non-local Optimizationcited by 7
- 2022Ki-Pode: Keypoint-based Implicit Pose Distribution Estimation of Rigid Objectscited by 7
- 2023Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Trackingcited by 7
- 2019Motion Reasoning for Goal-Based Imitation Learningcited by 6
- 2022Ambiguity-Aware Multi-Object Pose Optimization for Visually-Assisted Robot Manipulationcited by 6
- 2021Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domainscited by 5
- 2021VIPose: Real-time Visual-Inertial 6D Object Pose Trackingcited by 5
- 2022Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensingcited by 5
- 2022Video based Object 6D Pose Estimation using Transformerscited by 5
- 20233D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimationcited by 5
- 2025V-HOP: Visuo-Haptic 6D Object Pose Trackingcited by 5
- 2025DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objectscited by 5
50 most cited of 91 All 91 (JSON)
- 2026GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking30 Sep 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
- 2026Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers12 Apr 2026
- 2026Event-based Motion & Appearance Fusion for 6D Object Pose Tracking9 Mar 2026
- 2026Simulation-Ready Cluttered Scene Estimation via Physics-aware Joint Shape and Pose Optimization23 Feb 2026
- 2025Uncertainty Quantification for Visual Object Pose Estimation: S-Lemma Ellipsoidal Bounds26 Nov 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects13 Oct 2025
- 2025Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices28 Sep 2025
- 20256-DoF Object Tracking with Event-based Optical Flow and Frames20 Aug 2025
38 more
- 2025DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects16 Aug 2025
- 2025OmniShape: Zero-Shot Multi-Hypothesis Shape and Pose Estimation in the Real World5 Aug 2025
- 2025Active Control Points-based 6DoF Pose Tracking for Industrial Metal Objects2 Jul 2025
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Tracking8 Jun 2025
- 2025Scalable Unseen Objects 6-DoF Absolute Pose Estimation with Robotic Integration7 Mar 2025
- 2025Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames5 Mar 2025
- 2025V-HOP: Visuo-Haptic 6D Object Pose Tracking24 Feb 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025
- 2024A Novel Convolution and Attention Mechanism-based Model for 6D Object Pose Estimation31 Dec 2024
- 20246DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting2 Dec 2024
- 2024CVAM-Pose: Conditional Variational Autoencoder for Multi-Object Monocular Pose Estimation11 Oct 2024
- 2024OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB9 Oct 2024
- 2024RobotFingerPrint: Unified Gripper Coordinate Space for Multi-Gripper Grasp Synthesis and Transfer22 Sep 2024
- 2024MaskVal: Simple but Effective Uncertainty Quantification for 6D Pose Estimation5 Sep 2024
- 2024RUMI: Rummaging Using Mutual Information19 Aug 2024
- 2024HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction10 Jun 2024
- 2024Adapting Pre-Trained Vision Models for Novel Instance Detection and Segmentation28 May 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Resampling-free Particle Filters in High-dimensions21 Apr 2024
- 2024Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation12 Mar 2024
- 2024Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker9 Jan 2024
- 2023PACE: A Large-Scale Dataset with Pose Annotations in Cluttered Environments23 Dec 2023
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects13 Dec 2023
- 2023Uncertainty-aware 3D Object-Level Mapping with Deep Shape Priors17 Sep 2023
- 2023For A More Comprehensive Evaluation of 6DoF Object Pose Tracking14 Sep 2023
- 2023TrackAgent: 6D Object Tracking via Reinforcement Learning28 Jul 2023
- 2023Challenges for Monocular 6D Object Pose Estimation in Robotics22 Jul 2023
- 2023Reinforcement Learning with Frontier-Based Exploration via Autonomous Environment14 Jul 2023
- 2023SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenes27 Jun 2023
- 2023Multi-Object Manipulation via Object-Centric Neural Scattering Functions14 Jun 2023
- 2023Counter-Hypothetical Particle Filters for Single Object Pose Tracking28 May 2023
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Camera29 Mar 2023
- 2023Object-based SLAM utilizing unambiguous pose parameters considering general symmetry types13 Mar 2023
- 2023SpyroPose: SE(3) Pyramids for Object Pose Distribution Estimation9 Mar 2023
- 2023Fusing Visual Appearance and Geometry for Multi-modality 6DoF Object Tracking22 Feb 2023
- 20233D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation7 Feb 2023
- 2023Collision-aware In-hand 6D Object Pose Estimation using Multiple Vision-based Tactile Sensors31 Jan 2023
- 2022Physics-Based Object 6D-Pose Estimation during Non-Prehensile Manipulation24 Nov 2022
50 newest of 91 All 91 (JSON)
- 2019Motion Reasoning for Goal-Based Imitation Learningcited by 6
- 2019Motion Reasoning for Goal-Based Imitation Learning13 Nov 2019
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2023Visibility Aware Human-Object Interaction Tracking from Single RGB Cameracited by 58
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2021SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimationcited by 53
- 2021SORNet: Spatial Object-Centric Representations for Sequential Manipulationcited by 48
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
12 most cited of 90 All 90 (JSON)
- 2026GRC-Pose: Generation-Reconstruction Correspondence for Prior-Free 6D Object Pose Tracking30 Sep 2026
- 2026RRTrack: Robust and Recoverable Object 6D Pose Tracking for Dynamic Scenes26 Jul 2026
- 2026Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions26 Jul 2026
- 2026Temporally Consistent Object 6D Pose Estimation for Robot Control4 May 2026
- 2026Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers12 Apr 2026
- 2026Event-based Motion & Appearance Fusion for 6D Object Pose Tracking9 Mar 2026
- 2026Simulation-Ready Cluttered Scene Estimation via Physics-aware Joint Shape and Pose Optimization23 Feb 2026
- 2025Uncertainty Quantification for Visual Object Pose Estimation: S-Lemma Ellipsoidal Bounds26 Nov 2025
- 2025STORM: Segment, Track, and Object Re-Localization from a Single Image12 Nov 2025
- 2025DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects13 Oct 2025
- 2025Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices28 Sep 2025
- 20256-DoF Object Tracking with Event-based Optical Flow and Frames20 Aug 2025
12 newest of 90 All 90 (JSON)