Text-Guided Mask-free Local Image Retouching
Not on the map. Why?
Abstract (arXiv)
In the realm of multi-modality, text-guided image retouching techniques emerged with the advent of deep learning. Most currently available text-guided methods, however, rely on object-level supervision to constrain the region that may be modified. This not only makes it more challenging to develop these algorithms, but it also limits how widely deep learning can be used for image retouching. In this paper, we offer a text-guided mask-free image retouching approach that yields consistent results to address this concern. In order to perform image retouching without mask supervision, our technique can construct plausible and edge-sharp masks based on the text for each object in the image. Extensive experiments have shown that our method can produce high-quality, accurate images based on spoken language. The source code will be released soon.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 22 of its 25 references that are in the map. First posted on arXiv 15 Dec 2022.
Builds on
22 of 25 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
10 more
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2022Blended Latent Diffusioncited by 432
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
- 2015Generating Images from Captions with Attentioncited by 136
- 2021Paint by Wordcited by 107
- 2021Open-World Entity Segmentationcited by 74
- 2018Discriminability objective for training descriptive captionscited by 67
- 2022Re-Attention Transformer for Weakly Supervised Object Localizationcited by 11
Built on by
Citing papers per year: 2024: 3; 2025: 3.
6 papers.
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Modelscited by 21
- 2025Multi-turn Consistent Image Editingcited by 18
- 2024High-Quality Entity Segmentation and Groundingcited by 13
- 2025MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillationcited by 12
- 2025MaSS13K: A Matting-level Semantic Segmentation Benchmarkcited by 2
- 2025MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation6 Jul 2025
- 2025Multi-turn Consistent Image Editing7 May 2025
- 2025MaSS13K: A Matting-level Semantic Segmentation Benchmark24 Mar 2025
- 2024MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models16 Dec 2024
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb 2024
- 2024High-Quality Entity Segmentation and Grounding4 Feb 2024