DE-Net: Dynamic Text-guided Image Editing Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
Text-guided image editing models have shown remarkable results. However, there remain two problems. First, they employ fixed manipulation modules for various editing requirements (e.g., color changing, texture changing, content adding and removing), which results in over-editing or insufficient editing. Second, they do not clearly distinguish between text-required and text-irrelevant parts, which leads to inaccurate editing. To solve these limitations, we propose: (i) a Dynamic Editing Block (DEBlock) which composes different editing modules dynamically for various editing requirements. (ii) a Composition Predictor (Comp-Pred) which predicts the composition weights for DEBlock according to the inference on target texts and source images. (iii) a Dynamic text-adaptive Convolution Block (DCBlock) which queries source image features to distinguish text-required parts and text-irrelevant parts. Extensive experiments demonstrate that our DE-Net achieves excellent performance and manipulates source images more correctly and accurately. Code is available at urlhttps://github.com/tobran/DE-Net.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 2 Jun 2022.
Builds on
30 of 38 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2016Improved Techniques for Training GANscited by 2,970
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2016Generative Adversarial Text to Image Synthesiscited by 735
18 more
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
- 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
- 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 162
- 2019ManiGAN: Text-Guided Image Manipulationcited by 156
- 2019Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translationcited by 97
- 2021M6: A Chinese Multimodal Pretrainercited by 91
- 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
- 2017Semantic Image Synthesis via Adversarial Learningcited by 87
- 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
- 2021Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Modelcited by 34
- 2020Lightweight Generative Adversarial Networks for Text-Guided Image Manipulationcited by 33
- 2020Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approachcited by 29
- 2020Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructionscited by 25
- 2021Towards Open-World Text-Guided Face Image Generation and Manipulationcited by 25
- 2022ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generationcited by 13
Built on by
Citing papers per year: 2022: 1; 2023: 6; 2024: 3; 2025: 2.
12 papers.
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesiscited by 85
- 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Priorcited by 16
- 2023Text-to-image Editing by Image Information Removalcited by 12
- 2023DialogPaint: A Dialog-based Image Editing Modelcited by 8
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
- 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIPcited by 1
- 2024AnyDesign: Versatile Area Fashion Editing via Mask-Free Diffusioncited by 1
- 2025Towards Generalized and Training-Free Text-Guided Semantic Manipulationcited by 1
- 2025An Evaluation of Hybrid Annotation Workflows on High-Ambiguity Spatiotemporal Video Footagecited by 1
- 2025An Evaluation of Hybrid Annotation Workflows on High-Ambiguity Spatiotemporal Video Footage20 Oct 2025
- 2025Towards Generalized and Training-Free Text-Guided Semantic Manipulation24 Apr 2025
- 2024A Survey of Multimodal Composite Editing and Retrieval9 Sep 2024
- 2024AnyDesign: Versatile Area Fashion Editing via Mask-Free Diffusion21 Aug 2024
- 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Prior6 Jul 2024
- 2023Alchemist: Parametric Control of Material Properties with Diffusion Models5 Dec 2023
- 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesis22 Jul 2023
- 2023Text-to-image Editing by Image Information Removal27 May 2023
- 2023Robust Text-driven Image Editing Method that Adaptively Explores Directions in Latent Spaces of StyleGAN and CLIP3 Apr 2023
- 2023DialogPaint: A Dialog-based Image Editing Model17 Mar 2023
- 2023GALIP: Generative Adversarial CLIPs for Text-to-Image Synthesis30 Jan 2023
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting13 Dec 2022