mlsanityData to 7 Oct 2026

Learning by Planning: Language-Guided Global Image Editing

arXiv 2106.13156 ↗First posted 24 Jun 2021cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

Recently, language-guided global image editing draws increasing attention with growing application potentials. However, previous GAN-based methods are not only confined to domain-specific, low-resolution data but also lacking in interpretability. To overcome the collective difficulties, we develop a text-to-operation model to map the vague editing language request into a series of editing operations, e.g., change contrast, brightness, and saturation. Each operation is interpretable and differentiable. Furthermore, the only supervision in the task is the target image, which is insufficient for a stable training of sequential decisions. Hence, we propose a novel operation planning algorithm to generate possible editing sequences from the target image as pseudo ground truth. Comparison experiments on the newly collected MA5k-Req dataset and GIER dataset show the advantages of our methods. Code is available at https://jshi31.github.io/T2ONet.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 24 Jun 2021.

Builds on

31 of 47 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  8. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  9. 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 427
  10. 2015Neural Module Networkscited by 375
  11. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
  12. 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
19 more
  1. 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
  2. 2019Kornia: an Open Source Differentiable Computer Vision Library for PyTorchcited by 231
  3. 2019UPSNet: A Unified Panoptic Segmentation Networkcited by 175
  4. 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 161
  5. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  6. 2018Learning to Assemble Neural Module Tree Networks for Visual Groundingcited by 139
  7. 2017Inferring and Executing Programs for Visual Reasoningcited by 130
  8. 2017Learning to Reason: End-to-End Module Networks for Visual Question Answeringcited by 125
  9. 2016Modeling Relationships in Referential Expressions with Compositional Modular Networkscited by 106
  10. 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
  11. 2017Semantic Image Synthesis via Adversarial Learningcited by 87
  12. 2018Tell, Draw, and Repeat: Generating and Modifying Images Based on Continual Linguistic Instructioncited by 61
  13. 2018Diverse Image Synthesis from Semantic Layouts via Conditional IMLEcited by 60
  14. 2018Explainable Neural Computation via Stack Neural Module Networkscited by 54
  15. 2018Sequential Attention GAN for Interactive Image Editingcited by 33
  16. 2017Exposure: A White-Box Photo Post-Processing Frameworkcited by 27
  17. 2020A Benchmark and Baseline for Language-Driven Image Editingcited by 25
  18. 2019Bilinear Representation for Language-based Image Editing Using Conditional Generative Adversarial Networkscited by 8
  19. 2018Learning to Globally Edit Images with Textual Descriptioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 4; 2023: 5; 2024: 7; 2025: 6; 2026: 2.

25 papers.

Sort:

By area:

  1. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  2. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
  3. 2022DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonizationcited by 46
  4. 2024Towards Semantic Equivalence of Tokenization in Multimodal LLMcited by 45
  5. 2024Auto-Encoding Morph-Tokens for Multimodal LLMcited by 30
  6. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  7. 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 27
  8. 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokenscited by 27
  9. 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
  10. 2024CLIPtone: Unsupervised Learning for Text-based Image Tone Adjustmentcited by 10
  11. 2025MonetGPT: Solving Puzzles Enhances MLLMs' Image Retouching Skillscited by 10
  12. 2022Neural Color Operators for Sequential Image Retouchingcited by 8
13 more
  1. 2024Text-to-Image Cross-Modal Generation: A Systematic Reviewcited by 5
  2. 2025Understanding Generative AI Capabilities in Everyday Image Editing Taskscited by 5
  3. 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
  4. 2023Cross-Modal Attribute Insertions for Assessing the Robustness of Vision-and-Language Learningcited by 3
  5. 2021SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editingcited by 2
  6. 2022Contrastive Monotonic Pixel-Level Modulationcited by 2
  7. 2023Image Manipulation via Multi-Hop Instructions -- A New Dataset and Weakly-Supervised Neuro-Symbolic Approachcited by 2
  8. 2025What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Modelscited by 2
  9. 2025Language-driven Fine-grained Retrievalcited by 2
  10. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
  11. 2023Interactive Neural Paintingcited by 1
  12. 2024UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraintcited by 1
  13. 2022Cascade Luminance and Chrominance for Image Retouching: More Like Artistcited by 0