Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifold
Not on the map. Why?
Abstract (arXiv)
Single image pose estimation is a fundamental problem in many vision and robotics tasks, and existing deep learning approaches suffer by not completely modeling and handling: i) uncertainty about the predictions, and ii) symmetric objects with multiple (sometimes infinite) correct poses. To this end, we introduce a method to estimate arbitrary, non-parametric distributions on SO(3). Our key idea is to represent the distributions implicitly, with a neural network that estimates the probability given the input image and a candidate pose. Grid sampling or gradient ascent can be used to find the most likely pose, but it is also possible to evaluate the probability at any pose, enabling reasoning about symmetries and uncertainty. This is the most general way of representing distributions on manifolds, and to showcase the rich expressive power, we introduce a dataset of challenging symmetric and nearly-symmetric objects. We require no supervision on pose uncertainty -- the model trains only with a single pose per example. Nonetheless, our implicit model is highly expressive to handle complex distributions over 3D poses, while still obtaining accurate pose estimation on standard non-ambiguous environments, achieving state-of-the-art performance on Pascal3D+ and ModelNet10-SO(3) benchmarks.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 25 of its 53 references that are in the map. First posted on arXiv 10 Jun 2021.
Builds on
25 of 53 references.
References · 25
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
- 2020Normalizing Flows on Tori and Spherescited by 117
- 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
13 more
- 2020An Analysis of SVD for Deep Rotation Estimationcited by 85
- 2018Discovery of Latent 3D Keypoints via End-to-end Geometric Reasoningcited by 79
- 2018Explaining the Ambiguity of Object Detection and 6D Pose From Visual Datacited by 68
- 2014Viewpoints and Keypointscited by 59
- 2018Deep Directional Statistics: Pose Estimation with Uncertainty Quantificationcited by 45
- 2020Deep Bingham Networks: Dealing with Uncertainty and Ambiguity in Pose Estimationcited by 43
- 2019Spherical Regression: Learning Viewpoints, Surface Normals and 3D Rotations on n-Spherescited by 37
- 2020Probabilistic orientation estimation with matrix Fisher distributionscited by 36
- 2019On Object Symmetries and 6D Pose Estimation from Imagescited by 33
- 2018A Mixed Classification-Regression Framework for 3D Pose Estimation from 2D Imagescited by 19
- 2020Learning Orientation Distributions for Object Pose Estimationcited by 18
- 2018Pose Estimation for Objects with Rotational Symmetrycited by 15
- 2018Cross-Domain 3D Equivariant Image Embeddingscited by 12
Built on by
Citing papers per year: 2021: 4; 2022: 10; 2023: 24; 2024: 9; 2025: 13; 2026: 5.
65 papers.
Sort:
By area:
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 47
- 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3Dcited by 32
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2023Rigid Body Flows for Sampling Molecular Crystal Structurescited by 27
- 2022SC6D: Symmetry-agnostic and Correspondence-free 6D Object Pose Estimationcited by 17
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 17
38 more
- 2023Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)cited by 17
- 2023Symphony: Symmetry-Equivariant Point-Centered Spherical Harmonics for 3D Molecule Generationcited by 17
- 2022FisherMatch: Semi-Supervised Rotation Regression via Entropy-based Filteringcited by 16
- 2023SpyroPose: SE(3) Pyramids for Object Pose Distribution Estimationcited by 14
- 2023Delving into Discrete Normalizing Flows on SO(3) Manifold for Probabilistic Rotation Modelingcited by 14
- 2025Rectified Point Flow: Generic Point Cloud Pose Estimationcited by 13
- 2023A Probabilistic Framework for Visual Localization in Ambiguous Scenescited by 12
- 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulationcited by 10
- 2023A Laplace-inspired Distribution on SO(3) for Probabilistic Rotation Estimationcited by 9
- 2022Ki-Pode: Keypoint-based Implicit Pose Distribution Estimation of Rigid Objectscited by 7
- 2023Learning Distributions on Manifolds with Free-Form Flowscited by 7
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Modelscited by 7
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representationscited by 6
- 2021Simulation-based Bayesian inference for multi-fingered robotic graspingcited by 5
- 2022Multi-view object pose estimation from correspondence distributions and epipolar geometrycited by 5
- 2023Towards Robust Probabilistic Modeling on SO(3) via Rotation Laplace Distributioncited by 5
- 2023Shape Completion with Prediction of Uncertain Regionscited by 5
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysicscited by 5
- 2023MELON: NeRF with Unposed Images in SO(3)cited by 4
- 2023Stable Yaw Estimation of Boats from the Viewpoint of UAVs and USVscited by 4
- 2023Topological Obstructions and How to Avoid Themcited by 4
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Predictioncited by 4
- 2021Learning Proposals for Practical Energy-Based Regressioncited by 3
- 2024ADen: Adaptive Density Representations for Sparse-view Camera Pose Estimationcited by 3
- 2024BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguitiescited by 3
- 2025Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributionscited by 3
- 2022ObPose: Leveraging Pose for Object-Centric Scene Inference and Generation in 3Dcited by 2
- 2022Stable Object Reorientation using Contact Plane Registrationcited by 2
- 2022Learning Implicit Probability Distribution Functions for Symmetric Orientation Estimation from RGB Images Without Pose Labelscited by 2
- 2023A Probabilistic Rotation Representation for Symmetric Shapes With an Efficiently Computable Bingham Loss Functioncited by 2
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wildcited by 2
- 2024Alignist: CAD-Informed Orientation Distribution Estimation by Fusing Shape and Correspondencescited by 2
- 2025MatrixNet: Learning over symmetry groups using learned group representationscited by 2
- 2025ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Cloudscited by 2
- 2021Incremental Non-Gaussian Inference for SLAM Using Normalizing Flowscited by 1
- 2022Accidental Turntables: Learning 3D Pose by Watching Objects Turncited by 1
- 2023AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributionscited by 1
50 most cited of 65 All 65 (JSON)
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Towards a Modular Bin-picking Framework for Handling Object Pose Uncertainties15 Jul 2026
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2026HACMatch Semi-Supervised Rotation Regression with Hardness-Aware Curriculum Pseudo Labeling23 Mar 2026
- 2026Manifold Aware Denoising Score Matching (MAD)2 Mar 2026
- 2025Object Pose Distribution Estimation for Determining Revolution and Reflection Uncertainty in Point Clouds8 Dec 2025
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models1 Oct 2025
- 2025Parallel Sampling of Diffusion Models on SO(3)14 Jul 2025
- 2025Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception24 Jun 2025
- 2025ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds10 Jun 2025
- 2025Rectified Point Flow: Generic Point Cloud Pose Estimation5 Jun 2025
38 more
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2025Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions5 May 2025
- 2025Riemannian Neural Geodesic Interpolant22 Apr 2025
- 2025Object-Pose Estimation With Neural Population Codes19 Feb 2025
- 2025AnyPlace: Learning Generalized Object Placement for Robot Manipulation6 Feb 2025
- 2025MatrixNet: Learning over symmetry groups using learned group representations16 Jan 2025
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction1 Nov 2024
- 2024Alignist: CAD-Informed Orientation Distribution Estimation by Fusing Shape and Correspondences10 Sep 2024
- 2024BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguities30 Aug 2024
- 2024ADen: Adaptive Density Representations for Sparse-view Camera Pose Estimation16 Aug 2024
- 2024SABER-6D: Shape Representation Based Implicit Object Pose Estimation11 Aug 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024Semi-Supervised Unconstrained Head Pose Estimation in the Wild3 Apr 2024
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images3 Mar 2024
- 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3D22 Jan 2024
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics18 Dec 2023
- 2023Learning Distributions on Manifolds with Free-Form Flows15 Dec 2023
- 2023Topological Obstructions and How to Avoid Them12 Dec 2023
- 2023Multi-Irreducible Spectral Synchronization for Robust Rotation Averaging28 Nov 2023
- 2023Symphony: Symmetry-Equivariant Point-Centered Spherical Harmonics for 3D Molecule Generation27 Nov 2023
- 2023Shape Completion with Prediction of Uncertain Regions1 Aug 2023
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangement10 Jul 2023
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representations7 Jul 2023
- 2023Stable Yaw Estimation of Boats from the Viewpoint of UAVs and USVs24 Jun 2023
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2023A Probabilistic Rotation Representation for Symmetric Shapes With an Efficiently Computable Bingham Loss Function30 May 2023
- 2023Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)25 May 2023
- 2023Towards Robust Probabilistic Modeling on SO(3) via Rotation Laplace Distribution17 May 2023
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observations8 May 2023
- 2023Implicit representation priors meet Riemannian geometry for Bayesian robotic grasping18 Apr 2023
- 2023Delving into Discrete Normalizing Flows on SO(3) Manifold for Probabilistic Rotation Modeling8 Apr 2023
- 2023MELON: NeRF with Unposed Images in SO(3)14 Mar 2023
- 2023SpyroPose: SE(3) Pyramids for Object Pose Distribution Estimation9 Mar 2023
- 2023A Laplace-inspired Distribution on SO(3) for Probabilistic Rotation Estimation3 Mar 2023
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policy2 Mar 2023
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Prediction27 Feb 2023
- 2023Rigid Body Flows for Sampling Molecular Crystal Structures26 Jan 2023
- 2023AQuaMaM: An Autoregressive, Quaternion Manifold Model for Rapidly Estimating Complex SO(3) Distributions21 Jan 2023
50 newest of 65 All 65 (JSON)
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Modelscited by 47
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Modelscited by 7
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysicscited by 5
- 2025Parallel Sampling of Diffusion Models on SO(3)cited by 1
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimationcited by 1
- 2026Landscape-Awareness for Geometric View Diffusion Modelcited by 0
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models1 Oct 2025
- 2025Parallel Sampling of Diffusion Models on SO(3)14 Jul 2025
- 2023Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics18 Dec 2023
- 2023GenPose: Generative Category-level Object Pose Estimation via Diffusion Models18 Jun 2023
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2024Fourier Transporter: Bi-Equivariant Robotic Manipulation in 3Dcited by 32
- 2023Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-modal Rearrangementcited by 29
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2023Rigid Body Flows for Sampling Molecular Crystal Structurescited by 27
- 2022SC6D: Symmetry-agnostic and Correspondence-free 6D Object Pose Estimationcited by 17
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 17
- 2023Confronting Ambiguity in 6D Object Pose Estimation via Score-Based Diffusion on SE(3)cited by 17
12 most cited of 59 All 59 (JSON)
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Towards a Modular Bin-picking Framework for Handling Object Pose Uncertainties15 Jul 2026
- 2026HACMatch Semi-Supervised Rotation Regression with Hardness-Aware Curriculum Pseudo Labeling23 Mar 2026
- 2026Manifold Aware Denoising Score Matching (MAD)2 Mar 2026
- 2025Object Pose Distribution Estimation for Determining Revolution and Reflection Uncertainty in Point Clouds8 Dec 2025
- 2025Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception24 Jun 2025
- 2025ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds10 Jun 2025
- 2025Rectified Point Flow: Generic Point Cloud Pose Estimation5 Jun 2025
- 2025RECON: Robust symmetry discovery via Explicit Canonical Orientation Normalization19 May 2025
- 2025Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions5 May 2025
- 2025Riemannian Neural Geodesic Interpolant22 Apr 2025
- 2025Object-Pose Estimation With Neural Population Codes19 Feb 2025
12 newest of 59 All 59 (JSON)