mlsanityData to 7 Oct 2026

KV Inversion: KV Embeddings Learning for Text-Conditioned Real Image Action Editing

arXiv 2309.16608 ↗First posted 28 Sep 2023cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

Text-conditioned image editing is a recently emerged and highly practical task, and its potential is immeasurable. However, most of the concurrent methods are unable to perform action editing, i.e. they can not produce results that conform to the action semantics of the editing prompt and preserve the content of the original image. To solve the problem of action editing, we propose KV Inversion, a method that can achieve satisfactory reconstruction performance and action editing, which can solve two major problems: 1) the edited result can match the corresponding action, and 2) the edited object can retain the texture and identity of the original real image. In addition, our method does not require training the Stable Diffusion model itself, nor does it require scanning a large-scale dataset to perform time-consuming training.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 48 of its 50 references that are in the map. First posted on arXiv 28 Sep 2023.

Builds on

48 of 50 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2023Segment Anythingcited by 8,158
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
36 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  11. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  12. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  13. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  14. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  15. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  16. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  17. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  18. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  19. 2016Generative Adversarial Text to Image Synthesiscited by 735
  20. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  21. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
  22. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  23. 2023Zero-shot Image-to-Image Translationcited by 503
  24. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  25. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  26. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  27. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  28. 2019DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesiscited by 308
  29. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  30. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  31. 2017StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 229
  32. 2019Controllable Text-to-Image Generationcited by 187
  33. 2020DF-GAN: A Simple and Effective Baseline for Text-to-Image Synthesiscited by 161
  34. 2019ManiGAN: Text-Guided Image Manipulationcited by 156
  35. 2018Text-Adaptive Generative Adversarial Networks: Manipulating Images with Natural Languagecited by 90
  36. 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 46

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 13; 2025: 3; 2026: 3.

21 papers.

Sort:

By area:

  1. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  2. 2024DreamMatcher: Appearance Matching Self-Attention for Semantically-Consistent Text-to-Image Personalizationcited by 60
  3. 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
  4. 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Modelscited by 29
  5. 2023LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuningcited by 28
  6. 2024FreeCompose: Generic Zero-Shot Image Composition with Diffusion Priorcited by 16
  7. 2024LocInv: Localization-aware Inversion for Text-Guided Image Editingcited by 11
  8. 2024FastEdit: Fast Text-Guided Single-Image Editing via Semantic-Aware Diffusion Fine-Tuningcited by 10
  9. 2024Dual-Schedule Inversion: Training- and Tuning-Free Inversion for Real Image Editingcited by 8
  10. 2024DissolveStereo: Coarse Depth Injection for Zero-Shot Stereo Video Generationcited by 5
  11. 2024SpecRef: A Fast Training-free Baseline of Specific Reference-Condition Real Image Editingcited by 4
  12. 2024Move and Act: Enhanced Object Manipulation and Background Integrity for Image Editingcited by 4
9 more
  1. 2024ColorEdit: Training-free Image-Guided Color editing with diffusion modelcited by 4
  2. 2025Attention in Diffusion Model: A Surveycited by 4
  3. 2025Exploring the latent space of diffusion models directly through singular value decompositioncited by 3
  4. 2025InstructAttribute: Fine-grained Object Attributes editing with Instructioncited by 2
  5. 2026Personalized Image Generation via Human-in-the-loop Bayesian Optimizationcited by 2
  6. 2026Training-free image inversion for one-step diffusion modelscited by 2
  7. 2023Seal2Real: Prompt Prior Learning on Diffusion Model for Unsupervised Document Seal Data Generation and Realisationcited by 1
  8. 2024Latent Inversion with Timestep-aware Sampling for Training-free Non-rigid Editingcited by 1
  9. 2026Towards LLM-centric Affective Visual Customization via Efficient and Precise Emotion Manipulatingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Models
  2. 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing
  3. 2022Direct Inversion: Optimization-Free Text-Driven Real Image Editing with Diffusion Models
  4. 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editing
  5. 2025EditInfinity: Image Editing with Binary-Quantized Generative Models
  6. 2023ReGeneration Learning of Diffusion Models with Rich Prompts for Zero-Shot Image Translation
  7. 2023Forgedit: Text Guided Image Editing via Learning and Forgetting
  8. 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models