PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustment
Not on the map. Why?
Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Camera pose estimation is a long-standing computer vision problem that to date often relies on classical methods, such as handcrafted keypoint matching, RANSAC and bundle adjustment. In this paper, we propose to formulate the Structure from Motion (SfM) problem inside a probabilistic diffusion framework, modelling the conditional distribution of camera poses given input images. This novel view of an old problem has several advantages. (i) The nature of the diffusion framework mirrors the iterative procedure of bundle adjustment. (ii) The formulation allows a seamless integration of geometric constraints from epipolar geometry. (iii) It excels in typically difficult scenarios such as sparse views with wide baselines. (iv) The method can predict intrinsics and extrinsics for an arbitrary amount of images. We demonstrate that our method PoseDiffusion significantly improves over the classic SfM pipelines and the learned approaches on two real-world datasets. Finally, it is observed that our method can generalize across datasets without further training. Project page: https://posediffusion.github.io/
Key facts. Cited by 147 papers in the map (data through 14 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 27 Jun 2023.
Builds on
42 of 72 references.
References · 42
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Video Diffusion Modelscited by 2,305
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
30 more
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2016LIFT: Learned Invariant Feature Transformcited by 306
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 266
- 2017SSD-6D: Making RGB-based 3D detection and 6D pose estimation great againcited by 243
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 225
- 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 201
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2017A Survey of Structure from Motioncited by 158
- 2019Learning Two-View Correspondences and Geometry Using Order-Aware Networkcited by 149
- 2019Neural-Guided RANSAC: Learning Where to Sample Model Hypothesescited by 129
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 20193DRegNet: A Deep Neural Network for 3D Point Registrationcited by 96
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2022SparsePose: Sparse-View Camera Pose Regression and Refinementcited by 53
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Deep Two-View Structure-from-Motion Revisitedcited by 39
- 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
- 20223DG-STFM: 3D Geometric Guided Student-Teacher Feature Matchingcited by 14
Built on by
Citing papers per year: 2023: 8; 2024: 42; 2025: 60; 2026: 37.
147 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
38 more
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
- 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 116
- 2025SpatialTrackerV2: 3D Point Tracking Made Easycited by 87
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 72
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 67
- 2024MegaScenes: Scene-Level View Synthesis at Scalecited by 58
- 2024Video-Guided Foley Sound Generation with Multimodal Controlscited by 49
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
- 2024FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstructioncited by 41
- 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 40
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 40
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025DUNE: Distilling a Universal Encoder from Heterogeneous 2D and 3D Teacherscited by 32
- 2024Robust Incremental Structure-from-Motion with Hybrid Featurescited by 31
- 2024Reconstructing People, Places, and Camerascited by 31
- 2023Open-vocabulary object 6D pose estimationcited by 29
- 2025MP-SfM: Monocular Surface Priors for Robust Structure-from-Motioncited by 26
- 2026VGGT-Omegacited by 26
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-trainingcited by 22
- 2025DVGT: Driving Visual Geometry Transformercited by 21
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localizationcited by 20
- 2024SHINOBI: Shape and Illumination using Neural Object Decomposition via BRDF Optimization In-the-wildcited by 18
- 2025One2Any: One-Reference 6D Pose Estimation for Any Objectcited by 18
- 2023DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fieldscited by 17
- 2025Quantized Visual Geometry Grounded Transformercited by 17
- 2024PuzzleFusion++: Auto-agglomerative 3D Fracture Assembly by Denoise and Verifycited by 15
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Viewscited by 14
- 2024Multiway Point Cloud Mosaicking with Diffusion and Global Optimizationcited by 14
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
- 2025GP3: A 3D Geometry-Aware Policy with Multi-View Images for Robotic Manipulationcited by 12
- 2024DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstructioncited by 11
- 2025Rig3R: Rig-Aware Conditioning for Learned 3D Reconstructioncited by 11
- 2023Learning Structure-from-Motion with Graph Attention Networkscited by 10
50 most cited of 147 All 147 (JSON)
- 2026FreeLoc: Online Floorplan Localization via Diffusion-Aided Pose Refinement4 Oct 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026Zero-Shot Novel Depth Synthesis Using 3D Foundation Models Scene Representations3 Sep 2026
- 2026DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation31 Aug 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Learning 1-Bit LiDAR-based Localization with Auxiliary Objective26 Jun 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
38 more
- 2026Prompting Diffusion Models for Zero-Shot Instance Segmentation21 Jun 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026Global Structure-from-Motion Meets Feedforward Reconstruction25 May 2026
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2026VGGT-Omega14 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 2026LA-Pose: Latent Action Pretraining Meets Pose Estimation30 Apr 2026
- 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyond24 Apr 2026
- 2026PoseFM: Relative Camera Pose Estimation Through Flow Matching24 Apr 2026
- 2026OmniGCD: Abstracting Generalized Category Discovery for Modality Agnosticism16 Apr 2026
- 2026Particle Diffusion Matching: Random Walk Correspondence Search for the Alignment of Standard and Ultra-Widefield Fundus Images11 Apr 2026
- 2026Active Diffusion Matching: Score-based Iterative Alignment of Cross-Modal Retinal Images11 Apr 2026
- 2026LuMon: A Comprehensive Benchmark and Development Suite with Novel Datasets for Lunar Monocular Depth Estimation10 Apr 2026
- 2026LiveStre4m: Feed-Forward Live Streaming of Novel Views from Unposed Multi-View Video8 Apr 2026
- 2026Scene Grounding In the Wild27 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026A 3D Reconstruction Benchmark for Asset Inspection18 Mar 2026
- 2026AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priors27 Feb 2026
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces23 Feb 2026
- 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates21 Feb 2026
- 2026TrajVG: 3D Trajectory-Coupled Visual Geometry Learning4 Feb 2026
- 2026JOintGS: Joint Optimization of Cameras, Bodies and 3D Gaussians for In-the-Wild Monocular Reconstruction4 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2026Distill3R: A Pipeline for Democratizing 3D Foundation Models on Commodity Hardware31 Jan 2026
- 2026Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation20 Jan 2026
- 2025Learning to Anchor Visual Odometry: KAN-Based Pose Regression for Planetary Landing30 Dec 2025
- 2025Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformer26 Dec 2025
- 20256DAttack: Backdoor Attacks in the 6DoF Pose Estimation22 Dec 2025
- 2025DVGT: Driving Visual Geometry Transformer18 Dec 2025
- 2025Robust Multi-view Camera Calibration from Dense Matches17 Dec 2025
- 2025E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-training11 Dec 2025
- 2025Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignment9 Dec 2025
- 2025Emergent Extreme-View Geometry in 3D Foundation Models27 Nov 2025
- 2025Fin3R: Fine-tuning Feed-forward 3D Reconstruction Models via Monocular Knowledge Distillation27 Nov 2025
- 2025Depth Anything 3: Recovering the Visual Space from Any Views13 Nov 2025
- 2025RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation21 Oct 2025
- 2025OmniRaindrop: A Comprehensive Benchmark for Dual-Focused Raindrop Removal under Day and Night Scenes20 Oct 2025
- 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting12 Oct 2025
50 newest of 147 All 147 (JSON)
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Viewscited by 14
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
- 2025Can Video Diffusion Model Reconstruct 4D Geometry?cited by 10
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Modelscited by 7
- 2024The More You See in 2D, the More You Perceive in 3Dcited by 5
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Modelcited by 4
- 2024Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Viewscited by 2
- 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstructioncited by 2
- 2025DepthSync: Diffusion Guidance-Based Depth Synchronization for Scale- and Geometry-Consistent Video Depth Estimationcited by 2
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spacescited by 2
12 most cited of 23 All 23 (JSON)
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026An Evaluation Framework for Generating Multi-View Images of a Person in a Scene4 Sep 2026
- 2026DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation31 Aug 2026
- 2026Prompting Diffusion Models for Zero-Shot Instance Segmentation21 Jun 2026
- 2026Landscape-Awareness for Geometric View Diffusion Model19 May 2026
- 2026PoseFM: Relative Camera Pose Estimation Through Flow Matching24 Apr 2026
- 2026DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces23 Feb 2026
- 2026Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models3 Feb 2026
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models1 Oct 2025
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep 2025
- 2025DepthSync: Diffusion Guidance-Based Depth Synchronization for Scale- and Geometry-Consistent Video Depth Estimation2 Jul 2025
12 newest of 23 All 23 (JSON)
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 141
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 141
12 most cited of 120 All 120 (JSON)
- 2026FreeLoc: Online Floorplan Localization via Diffusion-Aided Pose Refinement4 Oct 2026
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Zero-Shot Novel Depth Synthesis Using 3D Foundation Models Scene Representations3 Sep 2026
- 2026HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions15 Aug 2026
- 2026Geometry-Aware Camera Localization for Bronchoscopy7 Aug 2026
- 2026Learning 1-Bit LiDAR-based Localization with Auxiliary Objective26 Jun 2026
- 2026Pose Anything Anywhere:Model-free Object Poses from Arbitrary References22 Jun 2026
- 2026Learning Cross-View Semantic Priors for Single-Reference Unseen Object Pose Estimation20 Jun 2026
- 2026Global Structure-from-Motion Meets Feedforward Reconstruction25 May 2026
- 2026VGGT-Omega14 May 2026
12 newest of 120 All 120 (JSON)