mlsanityData to 14 Oct 2026

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB

arXiv 2410.06694 ↗First posted 9 Oct 2024cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

To address the challenge of short-term object pose tracking in dynamic environments with monocular RGB input, we introduce a large-scale synthetic dataset OmniPose6D, crafted to mirror the diversity of real-world conditions. We additionally present a benchmarking framework for a comprehensive comparison of pose tracking algorithms. We propose a pipeline featuring an uncertainty-aware keypoint refinement network, employing probabilistic modeling to refine pose estimation. Comparative evaluations demonstrate that our approach achieves performance superior to existing baselines on real datasets, underscoring the effectiveness of our synthetic dataset and refinement technique in enhancing tracking precision in dynamic contexts. Our contributions set a new precedent for the development and assessment of object pose tracking methodologies in complex scenes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 55 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

41 of 55 references.

References · 41

  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  3. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  4. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  5. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  6. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  7. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  8. 2023CoTracker: It is Better to Track Togethercited by 522
  9. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
  10. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
  11. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
  12. 2022Kubric: A scalable dataset generatorcited by 381
29 more
  1. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  2. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
  3. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
  4. 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
  5. 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
  6. 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
  7. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  8. 2023Track Anything: Segment Anything Meets Videoscited by 234
  9. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
  10. 2022MegaPose: 6D Pose Estimation of Novel Objects via Render & Comparecited by 201
  11. 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 157
  12. 2023BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objectscited by 148
  13. 2022Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Imagescited by 121
  14. 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
  15. 2019PoseRBPF: A Rao-Blackwellized Particle Filter for 6D Object Pose Trackingcited by 91
  16. 2020se(3)-TrackNet: Data-driven 6D Pose Tracking by Calibrating Image Residuals in Synthetic Domainscited by 90
  17. 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
  18. 2021CAPTRA: CAtegory-level Pose Tracking for Rigid and Articulated Objects from Point Cloudscited by 84
  19. 20196-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypointscited by 78
  20. 2023Detector-Free Structure from Motioncited by 71
  21. 2019Visual Odometry Revisited: What Should Be Learnt?cited by 57
  22. 2018Long-term Tracking in the Wild: A Benchmarkcited by 55
  23. 2022Parallel Inversion of Neural Radiance Fields for Robust Pose Estimationcited by 55
  24. 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 48
  25. 2021NViSII: A Scriptable Tool for Photorealistic Image Generationcited by 24
  26. 2016Depth-Based Object Tracking Using a Robust Gaussian Filtercited by 22
  27. 2015Probabilistic Object Tracking using a Range Cameracited by 21
  28. 2022Keypoint-Based Category-Level Object Pose Tracking from an RGB Sequence with Uncertainty Estimationcited by 19
  29. 2022PIZZA: A Powerful Image-only Zero-Shot Zero-CAD Approach to 6 DoF Trackingcited by 15

Built on by

Not cited yet.