SatDreamer360: Multiview-Consistent Generation of Ground-Level Scenes from Satellite Imagery
Not on the map. Why?
Abstract (arXiv)
Generating multiview-consistent 360^circ ground-level scenes from satellite imagery is a challenging task with broad applications in simulation, autonomous navigation, and digital twin cities. Existing approaches primarily focus on synthesizing individual ground-view panoramas, often relying on auxiliary inputs like height maps or handcrafted projections, and struggle to produce multiview consistent sequences. In this paper, we propose SatDreamer360, a framework that generates geometrically consistent multi-view ground-level panoramas from a single satellite image, given a predefined pose trajectory. To address the large viewpoint discrepancy between ground and satellite images, we adopt a triplane representation to encode scene features and design a ray-based pixel attention mechanism that retrieves view-specific features from the triplane. To maintain multi-frame consistency, we introduce a panoramic epipolar-constrained attention module that aligns features across frames based on known relative poses. To support the evaluation, we introduce VIGOR++, a large-scale dataset for generating multi-view ground panoramas from a satellite image, by augmenting the original VIGOR dataset with more ground-view images and their pose annotations. Experiments show that SatDreamer360 outperforms existing methods in both satellite-to-ground alignment and multiview consistency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 65 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
58 of 65 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
38 more
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2016Generating Videos with Scene Dynamicscited by 376
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2021Urban Radiance Fieldscited by 263
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 189
- 2020Epipolar Transformerscited by 117
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2023Grid-guided Neural Radiance Fields for Large Urban Scenescited by 100
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 95
- 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95
- 2016Predicting Ground-Level Scene Layout from Aerial Imagerycited by 90
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2018Cross-View Image Synthesis using Conditional GANscited by 69
- 2022Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Camerascited by 59
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2022SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimationcited by 46
- 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
- 2023TriPlaneNet: An Encoder for EG3D Inversioncited by 41
- 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
- 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairscited by 29
- 2024Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusioncited by 27
- 2020Sat2Vid: Street-view Panoramic Video Synthesis from a Single Satellite Imagecited by 25
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
- 2024Weakly-supervised Camera Localization by Ground-to-satellite Image Registrationcited by 15
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Viewscited by 13
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.