OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB
Not on the map. Why?
Abstract (arXiv)
To address the challenge of short-term object pose tracking in dynamic environments with monocular RGB input, we introduce a large-scale synthetic dataset OmniPose6D, crafted to mirror the diversity of real-world conditions. We additionally present a benchmarking framework for a comprehensive comparison of pose tracking algorithms. We propose a pipeline featuring an uncertainty-aware keypoint refinement network, employing probabilistic modeling to refine pose estimation. Comparative evaluations demonstrate that our approach achieves performance superior to existing baselines on real datasets, underscoring the effectiveness of our synthetic dataset and refinement technique in enhancing tracking precision in dynamic contexts. Our contributions set a new precedent for the development and assessment of object pose tracking methodologies in complex scenes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 55 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
41 of 55 references.
References · 41
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
- 2022Kubric: A scalable dataset generatorcited by 381
29 more
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2023Track Anything: Segment Anything Meets Videoscited by 234
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
- 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 157
- 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
- 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2019PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Trackingcited by 91
- 2020se(3)-TrackNet: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domainscited by 90
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
- 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
- 2023Detector-Free Structure from Motioncited by 71
- 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
- 2018Long-term Tracking in the Wild: A Benchmarkcited by 55
- 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
- 2021NViSII: A Scriptable Tool for Photorealistic Image Generationcited by 24
- 2016Depth-Based Object Tracking Using a Robust Gaussian Filtercited by 22
- 2015Probabilistic Object Tracking using a Range Cameracited by 21
- 2022Keypoint-Based Category-Level Object Pose Tracking from an RGB Sequence with Uncertainty Estimationcited by 19
- 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Trackingcited by 15
Built on by
Not cited yet.