Cascaded Cross MLP-Mixer GANs for Cross-View Image Translation
Not on the map. Why?
Abstract (arXiv)
It is hard to generate an image at target view well for previous cross-view image translation methods that directly adopt a simple encoder-decoder or U-Net structure, especially for drastically different views and severe deformation cases. To ease this problem, we propose a novel two-stage framework with a new Cascaded Cross MLP-Mixer (CrossMLP) sub-network in the first stage and one refined pixel-level loss in the second stage. In the first stage, the CrossMLP sub-network learns the latent transformation cues between image code and semantic map code via our novel CrossMLP blocks. Then the coarse results are generated progressively under the guidance of those cues. Moreover, in the second stage, we design a refined pixel-level loss that eases the noisy semantic label problem with more reasonable regularization in a more compact fashion for better optimization. Extensive experimental results on Dayton~citevo2016localizing and CVUSA~citeworkman2015wide datasets show that our method can generate significantly better results than state-of-the-art methods. The source code and trained models are available at https://github.com/Amazingren/CrossMLP.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 45 of its 50 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
45 of 50 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
33 more
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2019Few-Shot Adversarial Learning of Realistic Neural Talking Head Modelscited by 284
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
- 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 186
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2016View Synthesis by Appearance Flowcited by 172
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2019Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translationcited by 97
- 2016Localizing and Orienting Street Views Using Overhead Imagerycited by 94
- 2016Predicting Ground-Level Scene Layout from Aerial Imagerycited by 90
- 2020XingGAN for Person Image Generationcited by 81
- 2019AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networkscited by 77
- 2017Beyond Face Rotation: Global and Local Perception GAN for Photorealistic and Identity Preserving Frontal View Synthesiscited by 75
- 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
- 2021Semantic Segmentation for Real Point Cloud Scenes via Bilateral Augmentation and Adaptive Fusioncited by 72
- 2018Cross-View Image Synthesis using Conditional GANscited by 69
- 2017Transformation-Grounded Image Generation Network for Novel 3D View Synthesiscited by 59
- 2015Multi-view 3D Models from Single Images with a Convolutional Networkcited by 58
- 2018Unsupervised Attention-guided Image to Image Translationcited by 58
- 2020Bipartite Graph Reasoning GANs for Person Image Generationcited by 34
- 2018Attention-GAN for Object Transfiguration in Wild Imagescited by 32
- 2018Generative Adversarial Frontal View to Bird View Synthesiscited by 25
- 2016Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesiscited by 24
- 2018DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks (with Supplementary Materials)cited by 21
- 2021Cross-View Exocentric to Egocentric Video Synthesiscited by 20
- 2020Exocentric to Egocentric Image Generation via Parallel Generative Adversarial Networkcited by 17
- 2021Layout-to-Image Translation with Double Pooling Generative Adversarial Networkscited by 8
- 2018Novel View Synthesis for Large-scale Scene using Adversarial Losscited by 1
Built on by
Citing papers per year: 2022: 8; 2023: 4; 2024: 4; 2025: 5.
21 papers.
Sort:
By area:
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
- 2022Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPscited by 20
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Viewscited by 13
- 2022Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesiscited by 9
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Resultscited by 8
- 2022Co-visual pattern augmented generative transformer learning for automobile geo-localizationcited by 5
- 2022PI-Trans: Parallel-ConvMLP and Implicit-Transformation Based GAN for Cross-View Image Translationcited by 4
- 2022Facial Expression Translation using Landmark Guided GANscited by 4
9 more
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Modelscited by 4
- 2025Satellite to GroundScape -- Large-scale Consistent Ground View Generation from Satellite Viewscited by 4
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generationcited by 3
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-trainingcited by 2
- 2022MLP-GAN for Brain Vessel Image Segmentationcited by 1
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial Viewcited by 1
- 2023Survey on Controlable Image Synthesis with Deep Learningcited by 0
- 2024Bird Eye-View to Street-View: A Surveycited by 0
- 2025From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesiscited by 0
- 2025From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesis29 Sep 2025
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Results19 Aug 2025
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-training12 Aug 2025
- 2025Satellite to GroundScape -- Large-scale Consistent Ground View Generation from Satellite Views22 Apr 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectives28 Nov 2024
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Views10 Jul 2024
- 2024Bird Eye-View to Street-View: A Survey14 May 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives30 Nov 2023
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View27 Nov 2023
- 2023Survey on Controlable Image Synthesis with Deep Learning18 Jul 2023
9 more
- 2023Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models15 Mar 2023
- 2022Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis12 Nov 2022
- 2022Facial Expression Translation using Landmark Guided GANs5 Sep 2022
- 2022MLP-GAN for Brain Vessel Image Segmentation17 Jul 2022
- 2022PI-Trans: Parallel-ConvMLP and Implicit-Transformation Based GAN for Cross-View Image Translation9 Jul 2022
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimation13 Jun 2022
- 2022Co-visual pattern augmented generative transformer learning for automobile geo-localization17 Mar 2022
- 2022Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPs8 Mar 2022
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generation28 Feb 2022
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 29
- 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
- 2022Skating-Mixer: Long-Term Sport Audio-Visual Modeling with MLPscited by 20
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Viewscited by 13
- 2022Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesiscited by 9
- 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Resultscited by 8
- 2022Co-visual pattern augmented generative transformer learning for automobile geo-localizationcited by 5
- 2022PI-Trans: Parallel-ConvMLP and Implicit-Transformation Based GAN for Cross-View Image Translationcited by 4
- 2022Facial Expression Translation using Landmark Guided GANscited by 4
12 most cited of 19 All 19 (JSON)
- 2025AIM 2025 challenge on Inverse Tone Mapping Report: Methods and Results19 Aug 2025
- 2025Masked Clustering Prediction for Unsupervised Point Cloud Pre-training12 Aug 2025
- 2025Satellite to GroundScape -- Large-scale Consistent Ground View Generation from Satellite Views22 Apr 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectives28 Nov 2024
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Views10 Jul 2024
- 2024Bird Eye-View to Street-View: A Survey14 May 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives30 Nov 2023
- 2023HawkI: Homography & Mutual Information Guidance for 3D-free Single Image to Aerial View27 Nov 2023
- 2023Survey on Controlable Image Synthesis with Deep Learning18 Jul 2023
- 2022Bipartite Graph Reasoning GANs for Person Pose and Facial Image Synthesis12 Nov 2022
12 newest of 19 All 19 (JSON)