CSHNet: A Novel Information Asymmetric Image Translation Method
Not on the map. Why?
Abstract (arXiv)
Despite advancements in cross-domain image translation, challenges persist in asymmetric tasks such as SAR-to-Optical and Sketch-to-Instance conversions, which involve transforming data from a less detailed domain into one with richer content. Traditional CNN-based methods are effective at capturing fine details but struggle with global structure, leading to unwanted merging of image regions. To address this, we propose the CNN-Swin Hybrid Network (CSHNet), which combines two key modules: Swin Embedded CNN (SEC) and CNN Embedded Swin (CES), forming the SEC-CES-Bottleneck (SCB). SEC leverages CNN's detailed feature extraction while integrating the Swin Transformer's structural bias. CES, in turn, preserves the Swin Transformer's global integrity, compensating for CNN's lack of focus on structure. Additionally, CSHNet includes two components designed to enhance cross-domain information retention: the Interactive Guided Connection (IGC), which enables dynamic information exchange between SEC and CES, and Adaptive Edge Perception Loss (AEPL), which maintains structural boundaries during translation. Experimental results show that CSHNet outperforms existing methods in both visual quality and performance metrics across scene-level and instance-level datasets. Our code is available at: https://github.com/XduShi/CSHNet.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 44 of its 82 references that are in the map. First posted on arXiv 17 Jan 2025.
Builds on
44 of 82 references.
References · 44
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 526
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
32 more
- 2022Vision Transformer with Deformable Attentioncited by 293
- 2017Learning to Discover Cross-Domain Relations with Generative Adversarial Networkscited by 278
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 234
- 2019U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translationcited by 186
- 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2017BEGAN: Boundary Equilibrium Generative Adversarial Networkscited by 121
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2021ViTGAN: Training GANs with Vision Transformerscited by 110
- 2021Contextual Transformer Networks for Visual Recognitioncited by 90
- 2021Delving Deep into the Generalization of Vision Transformers under Distribution Shiftscited by 85
- 2020Spatially-Adaptive Pixelwise Networks for Fast Image Translationcited by 45
- 2018The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusioncited by 42
- 2022Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Taskscited by 42
- 2022UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translationcited by 42
- 2023ControlStyle: Text-Driven Stylized Image Generation Using Diffusion Priorscited by 40
- 2021DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfercited by 38
- 2021DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Networkcited by 37
- 2017Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GANcited by 28
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2022InstaFormer: Instance-Aware Image-to-Image Translation with Transformercited by 28
- 2021Online Multi-Granularity Distillation for GAN Compressioncited by 24
- 2021SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removalcited by 22
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2022ITTR: Unpaired Image-to-Image Translation with Transformerscited by 15
- 2019Asymmetric GAN for Unpaired Image-to-image Translationcited by 14
- 2023Look ATME: The Discriminator Mean Entropy Needs Attentioncited by 6
- 2019One-Shot Image-to-Image Translation via Part-Global Learning with a Multi-adversarial Frameworkcited by 4
- 2022Unsupervised Structure-Consistent Image-to-Image Translationcited by 1
- 2024A4-Unet: Deformable Multi-Scale Attention Network for Brain Tumor Segmentationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.