BA-Net: Dense Bundle Adjustment Network
Not on the map. Why?
Abstract (arXiv)
This paper introduces a network architecture to solve the structure-from-motion (SfM) problem via feature-metric bundle adjustment (BA), which explicitly enforces multi-view geometry constraints in the form of feature-metric error. The whole pipeline is differentiable so that the network can learn suitable features that make the BA problem more tractable. Furthermore, this work introduces a novel depth parameterization to recover dense per-pixel depth. The network first generates several basis depth maps according to the input image and optimizes the final depth as a linear combination of these basis depth maps via feature-metric BA. The basis depth maps generator is also learned via end-to-end training. The whole system nicely combines domain knowledge (i.e. hard-coded multi-view geometry constraints) and deep learning (i.e. feature learning and basis depth maps learning) to address the challenging dense SfM problem. Experiments on large scale real data prove the success of the proposed method.
Key facts. Cited by 173 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Jun 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 29; 2022: 30; 2023: 32; 2024: 29; 2025: 34; 2026: 19.
173 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
38 more
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2022Deep Patch Visual Odometrycited by 186
- 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
- 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 146
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 107
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2024Stereo4D: Learning How Things Move in 3D from Internet Stereo Videoscited by 89
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 88
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
- 2023Detector-Free Structure from Motioncited by 71
- 2021Monocular 3D Object Detection: An Extrinsic Parameter Free Approachcited by 69
- 2022Theseus: A Library for Differentiable Nonlinear Optimizationcited by 64
- 2021RePOSE: Fast 6D Object Pose Refinement via Deep Texture Renderingcited by 63
- 2023PLGSLAM: Progressive Neural Scene Represenation with Local to Global Bundle Adjustmentcited by 62
- 2024FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descentcited by 61
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2022Motion Inspired Unsupervised Perception and Prediction in Autonomous Drivingcited by 59
- 2023Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedracited by 57
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
- 2023Dense RGB SLAM with Neural Implicit Mapscited by 42
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021Deep Two-View Structure-from-Motion Revisitedcited by 39
- 2021TANDEM: Tracking and Dense Mapping in Real-time using Deep Multi-view Stereocited by 39
- 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
- 2022RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimizationcited by 38
- 2022A Benchmark and a Baseline for Robust Multi-view Depth Estimationcited by 38
- 2023Tracking and Mapping in Medical Computer Vision: A Reviewcited by 36
50 most cited of 173 All 173 (JSON)
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026MomentBA: Second-order Spatial Moments for Anisotropic Correspondence Uncertainty in Differentiable Bundle Adjustment12 Sep 2026
- 2026NSFlow: End-to-End Differentiable Neuro-Symbolic Optical Flow for Visual Odometry5 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026Rolling Shutter Camera Self-Calibration2 Aug 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video27 Jun 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026Tango3D: Towards Alignment for Global and Local 2D-3D Correspondence19 May 2026
- 2026VGGT-Omega14 May 2026
38 more
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstruction9 Apr 2026
- 2026ViBA: Implicit Bundle Adjustment with Geometric and Temporal Consistency for Robust Visual Matching3 Apr 2026
- 2026Diff3R: Feed-forward 3D Gaussian Splatting with Uncertainty-aware Differentiable Optimization1 Apr 2026
- 2026Marginalized Bundle Adjustment: Multi-View Camera Pose from Monocular Depth Estimates21 Feb 2026
- 2026Distill3R: A Pipeline for Democratizing 3D Foundation Models on Commodity Hardware31 Jan 2026
- 2026GPA-VGGT:Adapting VGGT to Large Scale Localization by Self-Supervised Learning with Geometry and Physics Aware Loss23 Jan 2026
- 2025A Study of Finetuning Video Transformers for Multi-view Geometry Tasks21 Dec 2025
- 2025Trajectory Densification and Depth from Perspective-based Blur9 Dec 2025
- 2025Emergent Outlier View Rejection in Visual Geometry Grounded Transformers3 Dec 2025
- 2025TALO: Pushing 3D Vision Foundation Models Towards Globally Consistent Online Reconstruction2 Dec 2025
- 2025Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion1 Dec 2025
- 2025Policies over Poses: Reinforcement Learning based Distributed Pose-Graph Optimization for Multi-Robot SLAM26 Oct 2025
- 2025PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception20 Oct 2025
- 2025TTT3R: 3D Reconstruction as Test-Time Training30 Sep 2025
- 2025GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State28 Sep 2025
- 2025From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations28 Sep 2025
- 2025SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views21 Sep 2025
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool5 Sep 2025
- 2025Embodied Spatial Intelligence: from Implicit Scene Modeling to Spatial Reasoning30 Aug 2025
- 2025SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization25 Aug 2025
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformer14 Aug 2025
- 20253D Plant Root Skeleton Detection and Extraction11 Aug 2025
- 2025LONG3R: Long Sequence Streaming 3D Reconstruction24 Jul 2025
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequences22 Jul 2025
- 2025Stereo-GS: Multi-View Stereo Vision Model for Generalizable 3D Gaussian Splatting Reconstruction20 Jul 2025
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memory3 Jul 2025
- 2025ZeroVO: Visual Odometry with Minimal Assumptions9 Jun 2025
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion8 May 2025
- 2025Back on Track: Bundle Adjustment for Dynamic Scene Reconstruction20 Apr 2025
- 2025Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction18 Apr 2025
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Training31 Mar 2025
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstruction25 Mar 2025
- 2025Deblur Gaussian Splatting SLAM16 Mar 2025
- 2025VGGT: Visual Geometry Grounded Transformer14 Mar 2025
- 2025GigaSLAM: Large-Scale Monocular SLAM with Hierarchical Gaussian Splats11 Mar 2025
- 2025SIRE: SE(3) Intrinsic Rigidity Embeddings10 Mar 2025
50 newest of 173 All 173 (JSON)
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstructioncited by 1
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusioncited by 0
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion8 May 2025
- 2025GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion28 Mar 2025
- 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstruction25 Mar 2025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
12 most cited of 166 All 166 (JSON)
- 2026OTT3R: Multi-View 3D Reconstruction and Fast Dataset Generation at 1% Compute28 Sep 2026
- 2026MomentBA: Second-order Spatial Moments for Anisotropic Correspondence Uncertainty in Differentiable Bundle Adjustment12 Sep 2026
- 2026NSFlow: End-to-End Differentiable Neuro-Symbolic Optical Flow for Visual Odometry5 Sep 2026
- 2026BLASt3R: Bundle Adjustment of Any Image Set with Multi-View Matching and Monocular Priors4 Sep 2026
- 2026Stable and Scalable Bundle Adjustment of Holistic 3D Structures3 Sep 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026Rolling Shutter Camera Self-Calibration2 Aug 2026
- 2026Ground4D: Consistency-Aware 4D Reconstruction from Monocular Video27 Jun 2026
- 2026BA-T: An Iterative Transformer for Two-View Bundle Adjustment2 Jun 2026
- 2026Tango3D: Towards Alignment for Global and Local 2D-3D Correspondence19 May 2026
- 2026VGGT-Omega14 May 2026
- 2026Accelerating Transformer-Based Monocular SLAM via Geometric Utility Scoring9 Apr 2026
12 newest of 166 All 166 (JSON)