Image-to-image Translation via Hierarchical Style Disentanglement
Not on the map. Why?
Abstract (arXiv)
Recently, image-to-image translation has made significant progress in achieving both multi-label (ie, translation conditioned on different labels) and multi-style (ie, generation with diverse styles) tasks. However, due to the unexplored independence and exclusiveness in the labels, existing endeavors are defeated by involving uncontrolled manipulations to the translation results. In this paper, we propose Hierarchical Style Disentanglement (HiSD) to address this issue. Specifically, we organize the labels into a hierarchical tree structure, in which independent tags, exclusive attributes, and disentangled styles are allocated from top to bottom. Correspondingly, a new translation process is designed to adapt the above structure, in which the styles are identified for controllable translations. Both qualitative and quantitative results on the CelebA-HQ dataset verify the ability of the proposed HiSD. We hope our method will serve as a solid baseline and provide fresh insights with the hierarchically organized annotations for future research in image-to-image translation. The code has been released at https://github.com/imlixinyang/HiSD.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Builds on 50 of its 57 references that are in the map. First posted on arXiv 2 Mar 2021.
Builds on
50 of 57 references.
References · 50
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
38 more
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2016Colorful Image Colorizationcited by 1,113
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2017DualGAN: Unsupervised Dual Learning for Image-to-Image Translationcited by 310
- 2017Toward Multimodal Image-to-Image Translationcited by 295
- 2019DRIT++: Diverse Image-to-Image Translation via Disentangled Representationscited by 244
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 241
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2018GANimation: Anatomically-aware Facial Animation from a Single Imagecited by 160
- 2017Real-Time Adaptive Image Compressioncited by 127
- 2016Unsupervised Cross-Domain Image Generationcited by 125
- 2019STGAN: A Unified Selective Transfer Network for Arbitrary Image Attribute Editingcited by 119
- 2018Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Datacited by 76
- 2018Unsupervised Attention-guided Image to Image Translationcited by 58
- 2019RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributescited by 56
- 2018ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributescited by 50
- 2019SPA-GAN: Spatial Attention GAN for Image-to-Image Translationcited by 43
- 2019Multi-mapping Image-to-Image Translation via Learning Disentanglementcited by 35
- 2018SMIT: Stochastic Multi-Label Image-to-Image Translationcited by 21
- 2019Domain Intersection and Domain Differencecited by 17
- 2017DNA-GAN: Learning Disentangled Representations from Multi-Attribute Imagescited by 16
- 2018Modular Generative Adversarial Networkscited by 16
- 2020Emerging Disentanglement in Auto-Encoder Based Unsupervised Image Content Transfercited by 15
- 2017GeneGAN: Learning Object Transfiguration and Attribute Subspace from Unpaired Datacited by 11
- 2019SDIT: Scalable and Diverse Cross-domain Image Translationcited by 11
- 2019Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learningcited by 8
- 2019Mask Based Unsupervised Content Transfercited by 8
- 2019MulGAN: Facial Attribute Editing by Exemplarcited by 8
- 2019Information Competing Process for Learning Diversified Representationscited by 6
- 2017SRPGAN: Perceptual Generative Adversarial Network for Single Image Super Resolutioncited by 5
Built on by
Citing papers per year: 2021: 7; 2022: 17; 2023: 12; 2024: 12; 2025: 9; 2026: 6.
63 papers.
Sort:
By area:
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022Disentangled Representation Learningcited by 111
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 54
- 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translationcited by 39
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
- 2023Diverse Inpainting and Editing with GAN Inversioncited by 20
- 2023Detecting Generated Images by Real Images Onlycited by 20
- 2022Interactive Image Synthesis with Panoptic Layout Generationcited by 17
- 2022VecGAN: Image-to-Image Translation with Interpretable Latent Directionscited by 17
38 more
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2023Image-to-Image Translation with Disentangled Latent Vectors for Face Editingcited by 13
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detectioncited by 12
- 2022Portrait Eyeglasses and Shadow Removal by Leveraging 3D Synthetic Datacited by 11
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
- 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
- 2023Information-containing Adversarial Perturbation for Combating Facial Manipulation Systemscited by 9
- 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generationcited by 9
- 2024Reference-Based 3D-Aware Image Editing with Triplanescited by 9
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Modelscited by 9
- 2024FaceShield: Defending Facial Image against Deepfake Threatscited by 8
- 2021DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editingcited by 7
- 2022Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translationcited by 6
- 2023A Survey of Methods, Challenges and Perspectives in Causalitycited by 6
- 2023Warping the Residuals for Image Editing with StyleGANcited by 6
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editingcited by 6
- 2022PixelFolder: An Efficient Progressive Pixel Synthesis Network for Image Generationcited by 5
- 2022Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplarscited by 4
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identificationcited by 4
- 2022Design What You Desire: Icon Generation from Orthogonal Application and Theme Labelscited by 3
- 2023Feature Extraction Matters More: Universal Deepfake Disruption through Attacking Ensemble Feature Extractorscited by 3
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detectioncited by 3
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensicscited by 3
- 2022CCR: Facial Image Editing with Continuity, Consistency and Reversibilitycited by 2
- 2022Masked Reconstruction Contrastive Learning with Information Bottleneck Principlecited by 2
- 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworkscited by 2
- 2024OODFace: Benchmarking Robustness of Face Recognition under Common Corruptions and Appearance Variationscited by 2
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Stylescited by 2
- 2025Patch-Wise Hypergraph Contrastive Learning with Dual Normal Distribution Weighting for Multi-Domain Stain Transfercited by 2
- 2025Boosting Active Defense Persistence: A Two-Stage Defense Framework Combining Interruption and Poisoning Against Deepfakecited by 2
- 2022ChildPredictor: A Child Face Prediction Framework with Disentangled Learningcited by 1
- 2024An Analysis for Image-to-Image Translation and Style Transfercited by 1
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusioncited by 1
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editingcited by 1
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulationscited by 1
- 2021Delving into Rectifiers in Style-Based Image Translationcited by 0
50 most cited of 63 All 63 (JSON)
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing23 Apr 2026
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations2 Apr 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025Exploring Image Representation with Decoupled Classical Visual Descriptors16 Oct 2025
- 2025LoRA Patching: Exposing the Fragility of Proactive Defenses against Deepfakes4 Oct 2025
- 2025Disruptive Attacks on Face Swapping via Low-Frequency Perceptual Perturbations28 Aug 2025
- 2025Defending Deepfake via Texture Feature Perturbation24 Aug 2025
- 2025Boosting Active Defense Persistence: A Two-Stage Defense Framework Combining Interruption and Poisoning Against Deepfake11 Aug 2025
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics16 Apr 2025
38 more
- 2025A Knowledge-guided Adversarial Defense for Resisting Malicious Visual Manipulation11 Apr 2025
- 2025Patch-Wise Hypergraph Contrastive Learning with Dual Normal Distribution Weighting for Multi-Domain Stain Transfer12 Mar 2025
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles12 Feb 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024FaceShield: Defending Facial Image against Deepfake Threats13 Dec 2024
- 2024OODFace: Benchmarking Robustness of Face Recognition under Common Corruptions and Appearance Variations3 Dec 2024
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localization31 Oct 2024
- 2024Multi-sensor Learning Enables Information Transfer across Different Sensory Data and Augments Multi-modality Imaging28 Sep 2024
- 2024ID-Guard: A Universal Framework for Combating Facial Manipulation via Breaking Identification20 Sep 2024
- 2024An Analysis for Image-to-Image Translation and Style Transfer12 Aug 2024
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Models26 Jul 2024
- 2024A Reference-Based 3D Semantic-Aware Framework for Accurate Local Facial Attribute Editing25 Jul 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024Reference-Based 3D-Aware Image Editing with Triplanes4 Apr 2024
- 2024CoroNetGAN: Controlled Pruning of GANs via Hypernetworks13 Mar 2024
- 2023Warping the Residuals for Image Editing with StyleGAN18 Dec 2023
- 2023AVA: Inconspicuous Attribute Variation-based Adversarial Attack bypassing DeepFake Detection14 Dec 2023
- 2023Detecting Generated Images by Real Images Only2 Nov 2023
- 2023Image Denoising via Style Disentanglement26 Sep 2023
- 2023Diverse Inpainting and Editing with GAN Inversion27 Jul 2023
- 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generation1 Jun 2023
- 2023Text-guided Eyeglasses Manipulation with Spatial Constraints25 Apr 2023
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localization30 Mar 2023
- 2023Information-containing Adversarial Perturbation for Combating Facial Manipulation Systems21 Mar 2023
- 2023Feature Extraction Matters More: Universal Deepfake Disruption through Attacking Ensemble Feature Extractors1 Mar 2023
- 2023A Survey of Methods, Challenges and Perspectives in Causality1 Feb 2023
- 2023Image-to-Image Translation with Disentangled Latent Vectors for Face Editing11 Jan 2023
- 2022StyleRes: Transforming the Residuals for Real Image Editing with StyleGAN29 Dec 2022
- 2022CGOF++: Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields23 Nov 2022
- 2022Disentangled Representation Learning21 Nov 2022
- 2022Masked Reconstruction Contrastive Learning with Information Bottleneck Principle15 Nov 2022
- 2022GAN-based Facial Attribute Manipulation23 Oct 2022
- 2022CCR: Facial Image Editing with Continuity, Consistency and Reversibility22 Sep 2022
- 2022Design What You Desire: Icon Generation from Orthogonal Application and Theme Labels31 Jul 2022
- 2022VecGAN: Image-to-Image Translation with Interpretable Latent Directions7 Jul 2022
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fields16 Jun 2022
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translation25 May 2022
- 2022Exploring Negatives in Contrastive Learning for Unpaired Image-to-Image Translation23 Apr 2022
50 newest of 63 All 63 (JSON)
- 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generationcited by 9
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulationscited by 1
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulationcited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalitiescited by 0
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation23 Apr 2026
- 2026Diffusion-Guided Adversarial Perturbation Injection for Generalizable Defense Against Facial Manipulations2 Apr 2026
- 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generation1 Jun 2023
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Modelscited by 9
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensicscited by 3
- 2025Can GPT tell us why these images are synthesized? Empowering Multimodal Large Language Models for Forensics16 Apr 2025
- 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Models26 Jul 2024
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model26 Nov 2021
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022Disentangled Representation Learningcited by 111
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translationcited by 39
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2023Diverse Inpainting and Editing with GAN Inversioncited by 20
- 2023Detecting Generated Images by Real Images Onlycited by 20
- 2022Interactive Image Synthesis with Panoptic Layout Generationcited by 17
- 2022VecGAN: Image-to-Image Translation with Interpretable Latent Directionscited by 17
- 2022GAN-based Facial Attribute Manipulationcited by 16
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
12 most cited of 55 All 55 (JSON)
- 2026AttDiff-GAN: A Hybrid Diffusion-GAN Framework for Facial Attribute Editing23 Apr 2026
- 2026Beauty and the Beast: Imperceptible Perturbations Against Diffusion-Based Face Swapping via Directional Attribute Editing30 Jan 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025Exploring Image Representation with Decoupled Classical Visual Descriptors16 Oct 2025
- 2025LoRA Patching: Exposing the Fragility of Proactive Defenses against Deepfakes4 Oct 2025
- 2025Disruptive Attacks on Face Swapping via Low-Frequency Perceptual Perturbations28 Aug 2025
- 2025Defending Deepfake via Texture Feature Perturbation24 Aug 2025
- 2025Boosting Active Defense Persistence: A Two-Stage Defense Framework Combining Interruption and Poisoning Against Deepfake11 Aug 2025
- 2025A Knowledge-guided Adversarial Defense for Resisting Malicious Visual Manipulation11 Apr 2025
- 2025Patch-Wise Hypergraph Contrastive Learning with Dual Normal Distribution Weighting for Multi-Domain Stain Transfer12 Mar 2025
- 2025COutfitGAN: Learning to Synthesize Compatible Outfits Supervised by Silhouette Masks and Fashion Styles12 Feb 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
12 newest of 55 All 55 (JSON)