Polarimetric Pose Prediction
Not on the map. Why?
Abstract (arXiv)
Light has many properties that vision sensors can passively measure. Colour-band separated wavelength and intensity are arguably the most commonly used for monocular 6D object pose estimation. This paper explores how complementary polarisation information, i.e. the orientation of light wave oscillations, influences the accuracy of pose predictions. A hybrid model that leverages physical priors jointly with a data-driven learning strategy is designed and carefully tested on objects with different levels of photometric complexity. Our design significantly improves the pose accuracy compared to state-of-the-art photometric approaches and enables object pose estimation for highly reflective and transparent objects. A new multi-modal instance-level 6D object pose dataset with highly accurate pose annotations for multiple objects with varying photometric complexity is introduced as a benchmark.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 7 Dec 2021.
Builds on
32 of 65 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Mask R-CNNcited by 7,277
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2017BB8: A Scalable, Accurate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects without Using Depthcited by 225
- 2019Pix2Pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimationcited by 218
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
20 more
- 2019PVN3D: A Deep Point-wise 3D Keypoints Voting Network for 6DoF Pose Estimationcited by 204
- 2019DPOD: 6D Pose Object Detector and Refinercited by 189
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2020EPOS: Estimating 6D Pose of Objects with Symmetriescited by 148
- 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
- 2021FFB6D: A Full Flow Bidirectional Fusion Network for 6D Pose Estimationcited by 144
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2019HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objectscited by 110
- 2020HybridPose: 6D Object Pose Estimation under Hybrid Representationscited by 107
- 2018Segmentation-driven 6D Object Pose Estimationcited by 104
- 2019Single-Stage 6D Object Pose Estimationcited by 88
- 2021SO-Pose: Exploiting Self-Occlusion for Direct 6D Pose Estimationcited by 88
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2020Polarized Reflection Removal with Perfect Alignment in the Wildcited by 69
- 2018Explaining the Ambiguity of Object Detection and 6D Pose From Visual Datacited by 68
- 2015Learning Descriptors for Object Recognition and 3D Pose Estimationcited by 60
- 2019Multi-path Learning for Object Pose Estimation Across Domainscited by 52
- 2021StereOBJ-1M: Large-scale Stereo Image Dataset for 6D Object Pose Estimationcited by 40
- 2019Depth from a polarisation + RGB stereo paircited by 29
- 2020I Like to Move It: 6D Pose Estimation as an Action Decision Processcited by 22
Built on by
Citing papers per year: 2022: 3; 2023: 8; 2024: 3; 2025: 2.
16 papers.
Sort:
By area:
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 53
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imagingcited by 27
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
- 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regressioncited by 19
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 18
- 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Datasetcited by 8
- 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimationcited by 6
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applicationscited by 5
- 2025PolarAnything: Diffusion-based Polarimetric Image Synthesiscited by 5
- 2024PoTATO: A Dataset for Analyzing Polarimetric Traces of Afloat Trash Objectscited by 3
- 2022Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garmentcited by 2
4 more
- 2023S2P3: Self-Supervised Polarimetric Pose Predictioncited by 2
- 2022A Practical Calibration Method for RGB Micro-Grid Polarimetric Camerascited by 1
- 2023Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarizationcited by 1
- 2023Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Datacited by 0
- 2025PolarAnything: Diffusion-based Polarimetric Image Synthesis23 Jul 2025
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025
- 2024PoTATO: A Dataset for Analyzing Polarimetric Traces of Afloat Trash Objects19 Sep 2024
- 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimation11 Jul 2024
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applications5 Apr 2024
- 2023Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization22 Dec 2023
- 2023S2P3: Self-Supervised Polarimetric Pose Prediction2 Dec 2023
- 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Dataset29 Nov 2023
- 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimation22 Nov 2023
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation18 Nov 2023
- 2023Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data21 Aug 2023
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks26 Mar 2023
4 more
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging25 Jan 2023
- 2022A Practical Calibration Method for RGB Micro-Grid Polarimetric Cameras29 Aug 2022
- 2022Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garment5 Aug 2022
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regression9 May 2022
- 2025PolarAnything: Diffusion-based Polarimetric Image Synthesis23 Jul 2025
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimationcited by 53
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imagingcited by 27
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
- 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
- 2022Is my Depth Ground-Truth Good Enough? HAMMER -- Highly Accurate Multi-Modal Dataset for DEnse 3D Scene Regressioncited by 19
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimationcited by 18
- 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Datasetcited by 8
- 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimationcited by 6
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applicationscited by 5
- 2024PoTATO: A Dataset for Analyzing Polarimetric Traces of Afloat Trash Objectscited by 3
- 2022Disentangling 3D Attributes from a Single 2D Image: Human Pose, Shape and Garmentcited by 2
- 2023S2P3: Self-Supervised Polarimetric Pose Predictioncited by 2
12 most cited of 15 All 15 (JSON)
- 2025GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation6 Feb 2025
- 2024PoTATO: A Dataset for Analyzing Polarimetric Traces of Afloat Trash Objects19 Sep 2024
- 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimation11 Jul 2024
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applications5 Apr 2024
- 2023Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization22 Dec 2023
- 2023S2P3: Self-Supervised Polarimetric Pose Prediction2 Dec 2023
- 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Dataset29 Nov 2023
- 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimation22 Nov 2023
- 2023SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation18 Nov 2023
- 2023Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data21 Aug 2023
- 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Tasks26 Mar 2023
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging25 Jan 2023
12 newest of 15 All 15 (JSON)