EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Editing complex visual content from ambiguous or partially specified instructions remains a core challenge in vision-language modeling. Existing models can contextualize content but often fail to infer the underlying intent within a reference image or scene, leading to inconsistent or misaligned edits. We introduce the Editing Vision-Language Model (EVLM), a system that interprets ambiguous instructions in conjunction with reference visuals to produce precise, context-aware editing prompts. EVLM's key innovation is a reflective reasoning framework that translates subjective user intent into structured, actionable outputs by aligning with human-rated rationales through Reflection-Aware KL-Divergence Target Optimization (RKTO). By combining Chain-of-Thought (CoT) reasoning with RKTO alignment, EVLM captures fine-grained editing preferences without relying on binary supervision. Trained on a dataset of 30,000 CoT examples with human-annotated rationale quality, EVLM achieves substantial gains in alignment with human intent. Experiments across image, video, 3D, and 4D editing tasks show that EVLM generates coherent and high-quality instructions, providing a scalable foundation for multimodal editing and reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 35 of its 65 references that are in the map. First posted on arXiv 13 Dec 2024.
Builds on
35 of 65 references.
Closest ancestors · 6
Same direction, newest first
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflection30 Oct
- 2024TinyChart: Efficient Chart Understanding with Visual Token Merging and Program-of-Thoughts Learning25 Apr
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 29
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
17 more
- 2023mPLUG-Owl: Modularization Empowers Large Language Models with Multimodalitycited by 1,040
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 712
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024KTO: Model Alignment as Prospect Theoretic Optimizationcited by 264
- 2024Iterative Reasoning Preference Optimizationcited by 246
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
- 2024RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthinesscited by 131
- 2018Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videoscited by 128
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2024Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervisioncited by 96
- 2024CLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMscited by 49
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 48
- 2023Control4D: Efficient 4D Portrait Editing with Textcited by 32
- 2023Generative Visual Question Answeringcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
- 2026Reasoning-Informed Visual Editing
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2026Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning