mlsanityData to 7 Oct 2026

Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images

arXiv 2605.07978 ↗First posted 8 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-view localization classically asks: where does this ground image lie on the satellite tile? Existing methods are typically limited to 3-DoF estimates -- an (x,y) position and a yaw angle -- because nadir satellite imagery provides no direct cues for roll, pitch, or altitude, forcing a reliance on planar-motion and zero-tilt assumptions. These assumptions break on real terrain with slopes, ramps, and tilted camera mounts. To overcome this, we introduce a single UAV image as an intermediate viewpoint: it reveals the 3D structure invisible from nadir, supplies the cues for roll, pitch, and altitude that the satellite alone cannot provide, and needs only spatial overlap with the ground camera -- no known relative pose is required. Building on this insight, we propose **Cross3R**, a flexible feed-forward model that ingests a satellite tile together with a UAV image, a ground image, or both, and, in a single forward pass, recovers a cross-view 3D point cloud, the 6-DoF poses of every input camera, and the on-tile (x,y) position and yaw of each perspective camera. For training and evaluation, we also construct **CrossGeo**, a 278K-image tri-view dataset spanning 85 scenes across every continent except Antarctica. On CrossGeo, Cross3R consistently outperforms feed-forward 3D baselines in point-cloud reconstruction, 6-DoF camera-pose estimation, and cross-view localization. On KITTI, it outperforms dedicated cross-view methods trained on KITTI on most metrics, despite having no KITTI training itself.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

46 of 58 references.

References · 46

  1. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  4. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  5. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  7. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  8. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  9. 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
  10. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
  11. 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
  12. 2020Image Matching across Wide Baselines: From Paper to Practicecited by 224
34 more
  1. 2024Global Structure-from-Motion Revisitedcited by 215
  2. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  3. 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 188
  4. 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 185
  5. 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 179
  6. 2017Learning to Find Good Correspondencescited by 176
  7. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
  8. 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 100
  9. 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
  10. 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
  11. 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
  12. 2020DeepVideoMVS: Multi-View Stereo on Video with Recurrent Spatio-Temporal Fusioncited by 68
  13. 2022SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellitecited by 61
  14. 2023Fine-Grained Cross-View Geo-Localization Using a Correlation-Aware Homography Estimatorcited by 56
  15. 2025Light3R-SfM: Towards Feed-forward Structure-from-Motioncited by 47
  16. 2022SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimationcited by 46
  17. 2022Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matchingcited by 44
  18. 2025AerialMegaDepth: Learning Aerial-Ground Reconstruction and View Synthesiscited by 39
  19. 2023SNAP: Self-Supervised Neural Maps for Visual Positioning and Semantic Understandingcited by 38
  20. 2023Convolutional Cross-View Pose Estimationcited by 36
  21. 2025Depth Anything with Any Priorcited by 32
  22. 2025FG2: Fine-Grained Cross-View Localization by Fine-Grained Feature Matchingcited by 27
  23. 2023Learning Dense Flow Field for Highly-accurate Cross-view Camera Localizationcited by 24
  24. 2024Game4Loc: A UAV Geo-Localization Benchmark from Game Datacited by 24
  25. 2024UAV-VisLoc: A Large-scale Dataset for UAV Visual Localizationcited by 21
  26. 2024Weakly-supervised Camera Localization by Ground-to-satellite Image Registrationcited by 15
  27. 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
  28. 2025Exploring the best way for UAV visual localization under Low-altitude Multi-view Observation Condition: a Benchmarkcited by 11
  29. 2026PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagerycited by 10
  30. 2025GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localizationcited by 8
  31. 2025BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localizationcited by 7
  32. 2025PIDLoc: Cross-View Pose Optimization Network Inspired by PID Controllerscited by 4
  33. 2025CVD-SfM: A Cross-View Deep Front-end Structure-from-Motion System for Sparse Localization in Multi-Altitude Scenescited by 2
  34. 2025Flying Co-Stereo: Enabling Long-Range Aerial Dense Mapping via Collaborative Stereo Vision of Dynamic-Baselinecited by 1

Built on by

Not cited yet.