mlsanityData to 14 Oct 2026

SatDreamer360: Multiview-Consistent Generation of Ground-Level Scenes from Satellite Imagery

arXiv 2506.00600 ↗First posted 31 May 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating multiview-consistent 360^circ ground-level scenes from satellite imagery is a challenging task with broad applications in simulation, autonomous navigation, and digital twin cities. Existing approaches primarily focus on synthesizing individual ground-view panoramas, often relying on auxiliary inputs like height maps or handcrafted projections, and struggle to produce multiview consistent sequences. In this paper, we propose SatDreamer360, a framework that generates geometrically consistent multi-view ground-level panoramas from a single satellite image, given a predefined pose trajectory. To address the large viewpoint discrepancy between ground and satellite images, we adopt a triplane representation to encode scene features and design a ray-based pixel attention mechanism that retrieves view-specific features from the triplane. To maintain multi-frame consistency, we introduce a panoramic epipolar-constrained attention module that aligns features across frames based on known relative poses. To support the evaluation, we introduce VIGOR++, a large-scale dataset for generating multi-view ground panoramas from a satellite image, by augmenting the original VIGOR dataset with more ground-view images and their pose annotations. Experiments show that SatDreamer360 outperforms existing methods in both satellite-to-ground alignment and multiview consistency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 65 references that are in the map. First posted on arXiv 31 May 2025.

Builds on

58 of 65 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2023Segment Anythingcited by 8,234
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
38 more
  1. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  2. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  3. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  4. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
  5. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  6. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  7. 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
  8. 2016Generating Videos with Scene Dynamicscited by 376
  9. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  10. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  11. 2021Urban Radiance Fieldscited by 263
  12. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 256
  13. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  14. 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
  15. 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 189
  16. 2020Epipolar Transformerscited by 117
  17. 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
  18. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  19. 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
  20. 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
  21. 2023Grid-guided Neural Radiance Fields for Large Urban Scenescited by 100
  22. 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 95
  23. 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 95
  24. 2016Predicting Ground-Level Scene Layout from Aerial Imagerycited by 90
  25. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  26. 2018Cross-View Image Synthesis using Conditional GANscited by 69
  27. 2022Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Camerascited by 59
  28. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  29. 2022SliceMatch: Geometry-guided Aggregation for Cross-View Pose Estimationcited by 46
  30. 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
  31. 2023TriPlaneNet: An Encoder for EG3D Inversioncited by 41
  32. 2024Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusioncited by 39
  33. 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairscited by 29
  34. 2024Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusioncited by 27
  35. 2020Sat2Vid: Street-view Panoramic Video Synthesis from a Single Satellite Imagecited by 25
  36. 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
  37. 2024Weakly-supervised Camera Localization by Ground-to-satellite Image Registrationcited by 15
  38. 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Viewscited by 13

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.