UniEdit-I: Training-free Image Editing for Unified VLM via Iterative Understanding, Editing and Verifying
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
also in 1 more
Abstract (arXiv)
While Unified Vision-Language Models promise to synergistically combine the high-level semantic understanding of vision-language models with the generative fidelity of diffusion models, current editing methodologies remain fundamentally decoupled and open loop performing static, pre-defined transformations without dynamic feedback between semantic interpretation and visual generation. A central limitation stems from the representation gap: understanding typically leverages high-level, language aligned encoders, whereas generation relies on low level, pixel-space autoencoders, resulting in misaligned feature spaces. To bridge this gap, Recent advances such as Representation Autoencoders and BLIP3-o advocate performing diffusion-based modeling directly in high level features from pretrained semantic encoders. We find editing in the semantic latent space modifies conceptual representations rather than pixels, ensuring intermediates that are both semantically coherent and visually plausible. Building on this insight, We propose UniEdit-I, the first training-free, closed-loop image editing framework that operates entirely within the semantic latent space of a unified VLM by introducing an Understanding-Editing-Verifying (UEV) loop, By transforming the VLM from a posthoc evaluator into an in-process conductor, UniEdit-I establishes the first semantics-driven, self-correcting closed-loop image editing pipeline. Evaluated on GEdit-Bench, UniEdit-I achieves state of the art performance without any fine tuning or architectural modifications, and even surpasses several largescale pretrained editors.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 33 of its 43 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
33 of 43 references.
References · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
21 more
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2025Transfer between Modalities with MetaQueriescited by 236
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2024World Model on Million-Length Video And Language With Blockwise RingAttentioncited by 198
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2022Diffusion-based Image Translation using Disentangled Style and Content Representationcited by 149
- 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
- 2024ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generationcited by 114
- 2023Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenizationcited by 87
- 2025UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokenscited by 56
- 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 54
- 2023VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generationcited by 41
- 2022CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphicscited by 34
- 2024Pathways on the Image Manifold: Image Editing via Video Generationcited by 27
- 2025UGen: Unified Autoregressive Multimodal Model with Progressive Vocabulary Learningcited by 16
- 2024UNIT: Unifying Image and Text Recognition in One Vision Encodercited by 12
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesiscited by 6
- 2026EmoKGEdit: Training-free Affective Injection via Visual Cue Transformationcited by 4
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flowcited by 2
- 2026UniCompress: Token Compression for Unified Vision-Language Understanding and Generationcited by 1
- 2026SeamEdit: A Black-Box VLM-Agnostic Pipeline for Large-Image Semantic Editingcited by 0
- 2026Measured Sliders: Learning Continuous Controls from Differentiable Image Measurementscited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation8 Oct 2026
- 2026Measured Sliders: Learning Continuous Controls from Differentiable Image Measurements4 Sep 2026
- 2026SeamEdit: A Black-Box VLM-Agnostic Pipeline for Large-Image Semantic Editing11 Jun 2026
- 2026Grounded Forcing: Bridging Time-Independent Semantics and Proximal Dynamics in Autoregressive Video Synthesis8 Apr 2026
- 2026ConceptWeaver: Weaving Disentangled Concepts with Flow30 Mar 2026
- 2026UniCompress: Token Compression for Unified Vision-Language Understanding and Generation11 Mar 2026
- 2026EmoKGEdit: Training-free Affective Injection via Visual Cue Transformation18 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generation
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generation
- 2025VUGEN: Visual Understanding priors for GENeration
- 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Model
- 2024MUSE-VL: Modeling Unified VLM through Semantic Discrete Encoding
- 2026Language-Free Generative Editing from One Visual Example
- 2025Vision-Language-Vision Auto-Encoder: Scalable Knowledge Distillation from Diffusion Models
- 2025On the Limitations of Vision-Language Models in Understanding Image Transforms