mlsanityData to 14 Oct 2026

UniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifying

arXiv 2508.03142 ↗First posted 5 Aug 2025cs.CVcited by 7

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

also in 1 more
Abstract (arXiv)

While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally decoupled and open loop performing static, pre-defined transformations without dynamic feedback between semantic interpretation and visual generation. A central limitation stems from the representation gap: understanding typically leverages high-level, language aligned encoders, whereas generation relies on low level, pixel-space autoencoders, resulting in misaligned feature spaces. To bridge this gap, Recent advances such as Representation Autoencoders and BLIP3-o advocate performing diffusion-based modeling directly in high level features from pretrained semantic encoders. We find editing in the semantic latent space modifies conceptual representations rather than pixels, ensuring intermediates that are both semantically coherent and visually plausible. Building on this insight, We propose UniEdit-I, the first training-free, closed-loop image editing framework that operates entirely within the semantic latent space of a unified VLM by introducing an Understanding-Editing-Verifying (UEV) loop, By transforming the VLM from a posthoc evaluator into an in-process conductor, UniEdit-I establishes the first semantics-driven, self-correcting closed-loop image editing pipeline. Evaluated on GEdit-Bench, UniEdit-I achieves state of the art performance without any fine tuning or architectural modifications, and even surpasses several largescale pretrained editors.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 33 of its 43 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

33 of 43 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  8. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  11. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
21 more
  1. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
  2. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  3. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  4. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  5. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  6. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  7. 2025Transfer between Modalities with MetaQueriescited by 236
  8. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  9. 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 198
  10. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  11. 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
  12. 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
  13. 2024ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generationcited by 114
  14. 2023Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenizationcited by 87
  15. 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
  16. 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 54
  17. 2023VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generationcited by 41
  18. 2022CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphicscited by 34
  19. 2024Pathways on the Image Manifold: Image Editing via Video Generationcited by 27
  20. 2025UGen: Unified Autoregressive Multimodal Model with Progressive Vocabulary Learningcited by 16
  21. 2024UNIT: Unifying Image and Text Recognition in One Vision Encodercited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generation
  2. 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation
  3. 2025VUGEN: Visual Understanding priors for GENeration
  4. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model
  5. 2024MUSE-VL: Modeling Unified VLM through Semantic Discrete Encoding
  6. 2026Language-Free Generative Editing from One Visual Example
  7. 2025Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
  8. 2025On the Limitations of Vision-Language Models in Understanding Image Transforms