Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation
Not on the map. Why?
Abstract (arXiv)
Cross-view image translation is challenging because it involves images with drastically different views and severe deformation. In this paper, we propose a novel approach named Multi-Channel Attention SelectionGAN (SelectionGAN) that makes it possible to generate images of natural scenes in arbitrary viewpoints, based on an image of the scene and a novel semantic map. The proposed SelectionGAN explicitly utilizes the semantic information and consists of two stages. In the first stage, the condition image and the target semantic map are fed into a cycled semantic-guided generation network to produce initial coarse results. In the second stage, we refine the initial results by using a multi-channel attention selection mechanism. Moreover, uncertainty maps automatically learned from attentions are used to guide the pixel loss for better network optimization. Extensive experiments on Dayton, CVUSA and Ego2Top datasets show that our model is able to generate significantly better results than the state-of-the-art methods. The source code, data and trained models are available at https://github.com/Ha0Tang/SelectionGAN.
Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 18; 2023: 15; 2024: 21; 2025: 14; 2026: 2.
97 papers.
Sort:
By area:
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2023Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformercited by 45
- 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
38 more
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
- 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairscited by 29
- 2022Cross-View Panorama Image Synthesiscited by 26
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
- 2021Online Multi-Granularity Distillation for GAN Compressioncited by 24
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2024CV-Cities: Advancing Cross-View Geo-Localization in Global Citiescited by 22
- 2021Cascaded Cross MLP-Mixer GANs for Cross-View Image Translationcited by 21
- 2022OmniCity: Omnipotent City Understanding with Multi-level and Multi-view Imagescited by 21
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2021Cross-View Exocentric to Egocentric Video Synthesiscited by 20
- 2022Marginal Contrastive Correspondence for Guided Image Generationcited by 19
- 2022Satellite Image Based Cross-view Localization for Autonomous Vehiclecited by 19
- 2023Graph Transformer GANs for Graph-Constrained House Generationcited by 19
- 2025EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videoscited by 19
- 20223D-Aware Video Generationcited by 17
- 2021IAFA: Instance-aware Feature Aggregation for 3D Object Detection from a Single Imagecited by 15
- 2021Cloth Interactive Transformer for Virtual Try-Oncited by 15
- 2022Continual Attentive Fusion for Incremental Learning in Semantic Segmentationcited by 15
- 2024Cross-view geo-localization: a surveycited by 15
- 2021Visual and Object Geo-localization: A Comprehensive Surveycited by 13
- 2021Total Generate: Cycle in Cycle Generative Adversarial Networks for Generating Human Faces, Hands, Bodies, and Natural Scenescited by 12
- 2022DE-Net: Dynamic Text-guided Image Editing Adversarial Networkscited by 12
- 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesiscited by 11
- 2021Multi-Modal Perception Attention Network with Self-Supervised Learning for Audio-Visual Speaker Trackingcited by 9
- 2022Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesiscited by 9
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decorationcited by 9
- 2024Cross-View Meets Diffusion: Aerial Image Synthesis with Geometry and Text Guidancecited by 9
- 2025VAGeo: View-specific Attention for Cross-View Object Geo-Localizationcited by 9
- 2021Layout-to-Image Translation with Double Pooling Generative Adversarial Networkscited by 8
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Modelscited by 8
- 2025Seeing through Satellite Images at Street Viewscited by 8
- 2024SCP-Diff: Spatial-Categorical Joint Prior for Diffusion Based Semantic Image Synthesiscited by 7
- 2021Highly Efficient Natural Image Mattingcited by 6
- 2024Egocentric and Exocentric Methods: A Short Surveycited by 6
50 most cited of 97 All 97 (JSON)
- 2026Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image14 May 2026
- 2026Geo2: Geometry-Guided Cross-view Geo-Localization and Image Synthesis26 Mar 2026
- 2025Lifting Vision: Ground to Aerial Localization with Reasoning Guided Planning30 Dec 2025
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generation11 Nov 2025
- 2025Cross-view Localization and Synthesis -- Datasets, Challenges and Opportunities26 Oct 2025
- 2025From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesis29 Sep 2025
- 2025Cross-View Localization via Redundant Sliced Observations and A-Contrario Validation7 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolation3 Aug 2025
- 2025Seeing through Satellite Images at Street Views22 May 2025
- 2025EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videos16 Apr 2025
- 2025SimWorld: A Unified Benchmark for Simulator-Conditioned Scene Generation via World Model18 Mar 2025
38 more
- 2025STRMs: Spatial Temporal Reasoning Models for Vision-Based Localization Rivaling GPS Precision11 Mar 2025
- 2025Bridging Scales in Map Generation: A scale-aware cascaded generative mapping framework for seamless and consistent multi-scale cartographic representation7 Feb 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2025VAGeo: View-specific Attention for Cross-View Object Geo-Localization13 Jan 2025
- 2024Geometry-guided Cross-view Diffusion for One-to-many Cross-view Image Synthesis4 Dec 2024
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectives28 Nov 2024
- 2024Multimodal Alignment and Fusion: A Survey26 Nov 2024
- 2024Hierarchical Cross-Attention Network for Virtual Try-On23 Nov 2024
- 2024CV-Cities: Advancing Cross-View Geo-Localization in Global Cities19 Nov 2024
- 2024Which Viewpoint Shows it Best? Language for Weakly Supervising View Selection in Multi-view Instructional Videos13 Nov 2024
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approach29 Oct 2024
- 2024Egocentric and Exocentric Methods: A Short Survey27 Oct 2024
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis27 Aug 2024
- 2024An Explainable Non-local Network for COVID-19 Diagnosis8 Aug 2024
- 2024Cross-View Meets Diffusion: Aerial Image Synthesis with Geometry and Text Guidance8 Aug 2024
- 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesis3 Aug 2024
- 2024Semi-supervised reference-based sketch extraction using a contrastive learning framework19 Jul 2024
- 2024Mixed-View Panorama Synthesis using Geospatially Guided Diffusion12 Jul 2024
- 2024Cross-view geo-localization: a survey14 Jun 2024
- 2024Bird Eye-View to Street-View: A Survey14 May 2024
- 2024SCP-Diff: Spatial-Categorical Joint Prior for Diffusion Based Semantic Image Synthesis14 Mar 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
- 2024Graph Transformer GANs with Graph Masked Modeling for Architectural Layout Generation15 Jan 2024
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives30 Nov 2023
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View27 Nov 2023
- 2023OrthoNets: Orthogonal Channel Attention Networks6 Nov 2023
- 2023Masked Discriminators for Content-Consistent Unpaired Image-to-Image Translation22 Sep 2023
- 2023UGC: Unified GAN Compression for Efficient Image-to-Image Translation17 Sep 2023
- 2023Semantic-aware Network for Aerial-to-Ground Image Synthesis14 Aug 2023
- 2023Interactive Neural Painting31 Jul 2023
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesis22 Jul 2023
- 2023Conditional 360-degree Image Synthesis for Immersive Indoor Scene Decoration18 Jul 2023
- 2023Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformer16 Jul 2023
- 2023Synthetic Datasets for Autonomous Driving: A Survey24 Apr 2023
- 2023Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairs26 Mar 2023
- 2023Exploring the Power of Generative Deep Learning for Image-to-Image Translation and MRI Reconstruction: A Cross-Domain Review16 Mar 2023
50 newest of 97 All 97 (JSON)
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesiscited by 11
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Modelscited by 8
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Modelscited by 4
- 2024Mixed-View Panorama Synthesis using Geospatially Guided Diffusioncited by 4
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approachcited by 3
- 2025From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesiscited by 0
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generationcited by 0
- 2025Top2Ground: A Height-Aware Dual Conditioning Diffusion Model for Robust Aerial-to-Ground View Generation11 Nov 2025
- 2025From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesis29 Sep 2025
- 2024CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approach29 Oct 2024
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesis27 Aug 2024
- 2024Leveraging BEV Paradigm for Ground-to-Aerial Image Synthesis3 Aug 2024
- 2024Mixed-View Panorama Synthesis using Geospatially Guided Diffusion12 Jul 2024
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models15 Mar 2023
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translation22 Sep 2022
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equations14 Jul 2022
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2023Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformercited by 45
- 2021Geometry-Guided Street-View Panorama Synthesis from Satellite Imagerycited by 41
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
12 most cited of 85 All 85 (JSON)
- 2026Sat3DGen: Comprehensive Street-Level 3D Scene Generation from Single Satellite Image14 May 2026
- 2026Geo2: Geometry-Guided Cross-view Geo-Localization and Image Synthesis26 Mar 2026
- 2025Cross-view Localization and Synthesis -- Datasets, Challenges and Opportunities26 Oct 2025
- 2025Cross-View Localization via Redundant Sliced Observations and A-Contrario Validation7 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
- 2025Deep Learning-Driven Prediction of Microstructure Evolution via Latent Space Interpolation3 Aug 2025
- 2025Seeing through Satellite Images at Street Views22 May 2025
- 2025EgoExo-Gen: Ego-centric Video Prediction by Watching Exo-centric Videos16 Apr 2025
- 2025STRMs: Spatial Temporal Reasoning Models for Vision-Based Localization Rivaling GPS Precision11 Mar 2025
- 2025Bridging Scales in Map Generation: A scale-aware cascaded generative mapping framework for seamless and consistent multi-scale cartographic representation7 Feb 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2025VAGeo: View-specific Attention for Cross-View Object Geo-Localization13 Jan 2025
12 newest of 85 All 85 (JSON)