From Orbit to Ground: Generative City Photogrammetry from Extreme Off-Nadir Satellite Images
Not on the map. Why?
Abstract (arXiv)
City-scale 3D reconstruction from satellite imagery presents the challenge of extreme viewpoint extrapolation, where our goal is to synthesize ground-level novel views from sparse orbital images with minimal parallax. This requires inferring nearly 90^circ viewpoint gaps from image sources with severely foreshortened facades and flawed textures, causing state-of-the-art reconstruction engines such as NeRF and 3DGS to fail. To address this problem, we propose two design choices tailored for city structures and satellite inputs. First, we model city geometry as a 2.5D height map, implemented as a Z-monotonic signed distance field (SDF) that matches urban building layouts from top-down viewpoints. This stabilizes geometry optimization under sparse, off-nadir satellite views and yields a watertight mesh with crisp roofs and clean, vertically extruded facades. Second, we paint the mesh appearance from satellite images via differentiable rendering techniques. While the satellite inputs may contain long-range, blurry captures, we further train a generative texture restoration network to enhance the appearance, recovering high-frequency, plausible texture details from degraded inputs. Our method's scalability and robustness are demonstrated through extensive experiments on large-scale urban reconstruction. For example, in our teaser figure, we reconstruct a 4,km2 real-world region from only a few satellite images, achieving state-of-the-art performance in synthesizing photorealistic ground views. The resulting models are not only visually compelling but also serve as high-fidelity, application-ready assets for downstream tasks like urban planning and simulation. Project page can be found at https://pku-vcl-geometry.github.io/Orbit2Ground/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 54 of its 76 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
54 of 76 references.
References · 54
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2025DINOv3cited by 1,414
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
38 more
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2021Urban Radiance Fieldscited by 263
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
- 2024A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasetscited by 216
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2024CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussianscited by 192
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2023Neural Kernel Surface Reconstructioncited by 104
- 2023Grid-guided Neural Radiance Fields for Large Urban Scenescited by 100
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 94
- 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 88
- 2022Neural Dual Contouringcited by 71
- 2022Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Camerascited by 59
- 2024DOGS: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensuscited by 51
- 2024MVSFormer++: Revealing the Devil in Transformer's Details for Multi-View Stereocited by 50
- 2024CityGaussianV2: Efficient and Geometrically Accurate Reconstruction for Large-Scale Scenescited by 50
- 2024On Scaling Up 3D Gaussian Splatting Trainingcited by 49
- 2021Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetrycited by 47
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
- 2023Efficient Large-scale Scene Representation with a Hybrid of High-resolution Grid and Plane Featurescited by 36
- 2025FlowR: Flowing from Sparse to Dense 3D Reconstructionscited by 28
- 2025CityGS-X: A Scalable Architecture for Efficient and Geometrically Accurate Large-Scale Scene Reconstructioncited by 26
- 2019Leveraging Vision Reconstruction Pipelines for Satellite Imagerycited by 23
- 2023SparseSat-NeRF: Dense Depth Supervised Neural Radiance Fields for Sparse Satellite Imagescited by 18
- 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 17
- 2025Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusioncited by 16
- 2024Gaussian Splatting for Efficient Satellite Image Photogrammetrycited by 15
- 2021Rational Polynomial Camera Model Warping for Deep Learning Based Satellite Multi-View Stereo Matchingcited by 14
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026ABot-Earth 0.5: Generative 3D Earth Modelcited by 2
- 2026GS-Voxel: Fitting-Free Structured Latents for Large-Scale 3DGS Generationcited by 2
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Viewscited by 1
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Spacecited by 1
- 2026SatSplatDiff: Geometry-preserving generative refinement for high-fidelity satellite Gaussian Splattingcited by 0
- 2026GS-Voxel: Fitting-Free Structured Latents for Large-Scale 3DGS Generation18 Aug 2026
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul 2026
- 2026SatSplatDiff: Geometry-preserving generative refinement for high-fidelity satellite Gaussian Splatting25 Jun 2026
- 2026ABot-Earth 0.5: Generative 3D Earth Model8 Jun 2026
- 2026Feed-Forward Gaussian Splatting from Sparse Aerial Views19 May 2026