Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images
Not on the map. Why?
Abstract (arXiv)
Cross-view localization classically asks: where does this ground image lie on the satellite tile? Existing methods are typically limited to 3-DoF estimates -- an (x,y) position and a yaw angle -- because nadir satellite imagery provides no direct cues for roll, pitch, or altitude, forcing a reliance on planar-motion and zero-tilt assumptions. These assumptions break on real terrain with slopes, ramps, and tilted camera mounts. To overcome this, we introduce a single UAV image as an intermediate viewpoint: it reveals the 3D structure invisible from nadir, supplies the cues for roll, pitch, and altitude that the satellite alone cannot provide, and needs only spatial overlap with the ground camera -- no known relative pose is required. Building on this insight, we propose **Cross3R**, a flexible feed-forward model that ingests a satellite tile together with a UAV image, a ground image, or both, and, in a single forward pass, recovers a cross-view 3D point cloud, the 6-DoF poses of every input camera, and the on-tile (x,y) position and yaw of each perspective camera. For training and evaluation, we also construct **CrossGeo**, a 278K-image tri-view dataset spanning 85 scenes across every continent except Antarctica. On CrossGeo, Cross3R consistently outperforms feed-forward 3D baselines in point-cloud reconstruction, 6-DoF camera-pose estimation, and cross-view localization. On KITTI, it outperforms dedicated cross-view methods trained on KITTI on most metrics, despite having no KITTI training itself.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
46 of 58 references.
References · 46
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 224
34 more
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 188
- 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 185
- 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 179
- 2017Learning to Find Good Correspondencescited by 176
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
- 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2020DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusioncited by 68
- 2022SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellitecited by 61
- 2023Fine-Grained Cross-View Geo-Localization Using a Correlation-Aware Homography Estimatorcited by 56
- 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
- 2022SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimationcited by 46
- 2022Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matchingcited by 44
- 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
- 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
- 2023Convolutional Cross-View Pose Estimationcited by 36
- 2025Depth Anything with Any Priorcited by 32
- 2025FG2: Fine-Grained Cross-View Localization by Fine-Grained Feature Matchingcited by 27
- 2023Learning Dense Flow Field for Highly-accurate Cross-view Camera Localizationcited by 24
- 2024Game4Loc: A UAV Geo-Localization Benchmark from Game Datacited by 24
- 2024UAV-VisLoc: A Large-scale Dataset for UAV Visual Localizationcited by 21
- 2024Weakly-supervised Camera Localization by Ground-to-satellite Image Registrationcited by 15
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2025Exploring the best way for UAV visual localization under Low-altitude Multi-view Observation Condition: a Benchmarkcited by 11
- 2026PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagerycited by 10
- 2025GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localizationcited by 8
- 2025BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localizationcited by 7
- 2025PIDLoc: Cross-View Pose Optimization Network Inspired by PID Controllerscited by 4
- 2025CVD-SfM: A Cross-View Deep Front-end Structure-from-Motion System for Sparse Localization in Multi-Altitude Scenescited by 2
- 2025Flying Co-Stereo: Enabling Long-Range Aerial Dense Mapping via Collaborative Stereo Vision of Dynamic-Baselinecited by 1
Built on by
Not cited yet.