Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Most self-supervised 6D object pose estimation methods can only work with additional depth information or rely on the accurate annotation of 2D segmentation masks, limiting their application range. In this paper, we propose a 6D object pose estimation method that can be trained with pure RGB images without any auxiliary information. We first obtain a rough pose initialization from networks trained on synthetic images rendered from the target's 3D mesh. Then, we introduce a refinement strategy leveraging the geometry constraint in synthetic-to-real image pairs from multiple different views. We formulate this geometry constraint as pixel-level flow consistency between the training images with dynamically generated pseudo labels. We evaluate our method on three challenging datasets and demonstrate that it outperforms state-of-the-art self-supervised methods significantly, with neither 2D annotations nor additional depth images.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 19 Aug 2023.
Builds on
52 of 66 references.
References · 52
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2017Mask R-CNNcited by 7,277
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2017Neural 3D Mesh Renderercited by 437
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 316
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
38 more
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Losscited by 202
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2018ROI-10D: Monocular Lifting of 2D Detection to 6D Pose and Metric Shapecited by 123
- 2021Humble Teachers Teach Better Students for Semi-Supervised Object Detectioncited by 116
- 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 116
- 2018Segmentation-driven 6D Object Pose Estimationcited by 104
- 2021SurfEmb: Dense and Continuous Correspondence Distributions for Object Pose Estimation with Learnt Surface Embeddingscited by 95
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2020Self6D: Self-Supervised Monocular 6D Object Pose Estimationcited by 79
- 2023EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimationcited by 79
- 2021SMURF: Self-Teaching Multi-Frame Unsupervised RAFT with Full-Image Warpingcited by 74
- 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
- 2019End-to-End Learnable Geometric Vision by Backpropagating PnP Optimizationcited by 65
- 2021RePOSE: Fast 6D Object Pose Refinement via Deep Texture Renderingcited by 63
- 2022Semi-supervised Semantic Segmentation with Error Localization Networkcited by 57
- 2022PseCo: Pseudo Labeling and Consistency Training for Semi-Supervised Object Detectioncited by 51
- 2018Deep Unsupervised Saliency Detection: A Multiple Noisy Labeling Perspectivecited by 50
- 2022Coupled Iterative Refinement for 6D Multi-Object Pose Estimationcited by 48
- 2022Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detectioncited by 48
- 2021Wide-Depth-Range 6D Object Pose Estimation in Spacecited by 45
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimationcited by 40
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2022Occlusion-Aware Self-Supervised Monocular 6D Object Pose Estimationcited by 34
- 2017LabelFusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenescited by 32
- 2022Perspective Flow Aggregation for Data-Limited 6D Object Pose Estimationcited by 32
- 2015Learning Analysis-by-Synthesis for 6D Pose Estimation in RGB-D Imagescited by 29
- 2022Symmetry and Uncertainty-Aware Object SLAM for 6DoF Object Pose Estimationcited by 28
- 2023Spatiotemporal Self-supervised Learning for Point Clouds in the Wildcited by 23
- 2022Neural Correspondence Field for Object Pose Estimationcited by 21
- 2022Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin Pickingcited by 20
- 2022SC6D: Symmetry-agnostic and Correspondence-free 6D Object Pose Estimationcited by 17
- 2023Shape-Constraint Recurrent Flow for 6D Object Pose Estimationcited by 17
- 2021DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistencycited by 14
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 3; 2026: 2.
9 papers.
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Surveycited by 40
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolationcited by 7
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Cameracited by 2
- 2024Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimationcited by 1
- 2024FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimationcited by 1
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matchingcited by 1
- 2025SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flowcited by 1
- 2026Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancementscited by 0
- 2026ComPose: When to Trust Hands for Object Pose Trackingcited by 0
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements4 Mar 2026
- 2025SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow12 Apr 2025
- 2025Hierarchical Flow Diffusion for Efficient Frame Interpolation1 Apr 2025
- 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Camera26 Mar 2025
- 2024Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching24 Nov 2024
- 2024FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation25 Sep 2024
- 2024Deep Learning-Based Object Pose Estimation: A Comprehensive Survey13 May 2024
- 2024Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation19 Mar 2024