IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v1
Not on the map. Why?
Abstract (arXiv)
Relative pose estimation is fundamental for SLAM, visual localization, and 3D reconstruction. Existing Relative Pose Regression (RPR) methods face a key trade-off: feature-matching pipelines achieve high accuracy but block gradient flow via non-differentiable RANSAC, while ViT-based regressors are end-to-end trainable but prohibitively expensive for real-time deployment. We identify the core bottlenecks as the coupling between rotation and translation estimation and insufficient cross-view feature alignment. We propose IUP-Pose, a geometry-driven decoupled iterative framework with implicit dense alignment. A lightweight Multi-Head Bi-Cross Attention (MHBC) module aligns cross-view features without explicit matching supervision. The aligned features are processed by a decoupled rotation-translation pipeline: two shared-parameter rotation stages iteratively refine rotation with uncertainty, and feature maps are realigned via rotational homography H_inf before translation prediction. IUP-Pose achieves 73.3% AUC@20deg on MegaDepth1500 with full end-to-end differentiability, 70 FPS throughput, and only 37M parameters, demonstrating a favorable accuracy-efficiency trade-off for real-time edge deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 55 of its 72 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
55 of 72 references.
References · 55
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
38 more
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 352
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2020DISK: Learning local features with policy gradientcited by 310
- 2023RoMa: Robust Dense Feature Matchingcited by 296
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2018DeepIM: Deep Iterative Matching for 6D Pose Estimationcited by 283
- 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
- 2019R2D2: Repeatable and Reliable Detector and Descriptorcited by 206
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 174
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 170
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 119
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2017Repeatability Is Not Enough: Learning Affine Regions via Discriminabilitycited by 57
- 2024HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstructioncited by 55
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2017Relative Camera Pose Estimation Using Convolutional Neural Networkscited by 47
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 44
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2023Neural Refinement for Absolute Pose Regression with Feature Synthesiscited by 37
- 2024What is YOLOv5: A deep look into the internal features of the popular object detectorcited by 34
- 2021Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlationcited by 28
- 2022End2End Multi-View Feature Matching with Differentiable Pose Optimizationcited by 19
- 2023Pose-Oriented Transformer with Uncertainty-Guided Refinement for 2D-to-3D Human Pose Estimationcited by 19
- 2024HR-APR: APR-agnostic Framework with Uncertainty Estimation and Hierarchical Refinement for Camera Relocalisationcited by 16
- 2023Enhancing Deformable Local Features by Jointly Learning to Detect and Describe Keypointscited by 11
- 2021DistillPose: Lightweight Camera Localization Using Auxiliary Learningcited by 10
- 2023IMP: Iterative Matching and Pose Estimation with Adaptive Poolingcited by 10
- 2024Learning to Produce Semi-dense Correspondences for Visual Localizationcited by 10
- 2025GoTrack: Generic 6DoF Object Pose Refinement and Trackingcited by 10
- 2021HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertaintycited by 9
- 2022VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimationcited by 9
- 2025UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial Referencescited by 9
- 2022The Probabilistic Normal Epipolar Constraint for Frame-To-Frame Rotation Optimization under Uncertain Feature Positionscited by 8
- 2023LFM-3D: Learnable Feature Matching Across Wide Baselines Using 3D Signalscited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Not cited yet.