Evaluation-Verification Reward for Consistent Multi-Reference Image Editing
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency across references and ensuring overall visual harmony. Reinforcement learning has proven highly effective for text-to-image generation and single-image editing, but its extension to multi-reference editing is hindered by the absence of suitable reward models that capture multi-image relational constraints. Moreover, naively using multimodal large language models(MLLMs) as zero-shot evaluators faces a key tension between hallucination-prone long-form reasoning and the limited deductive power of short-form judgments. We address these issues with a Multi-dimensional Evaluation-Verification Reward(EVR). EVR decomposes evaluation into distinct visual criteria; for each criterion, an MLLM Evaluator generates multiple candidate hypotheses, and a Verifier grounds each claim in concrete visual evidence to accept or reject it, producing reliable and fine-grained reward signals. Together with a scalable data pipeline, our method enables RL fine-tuning of off-the-shelf editors without architectural changes. Extensive experiments show substantial gains over the base Qwen-Image-Edit, improving consistency and harmony to match or surpass NanoBanana.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 43 of its 48 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
43 of 48 references.
Closest ancestors · 10
Same direction, newest first
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedback19 Oct
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
- 2025RewardDance: Reward Scaling in Visual Generation10 Sep
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Models6 Aug
- 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
- 2024Aligning Diffusion Models by Optimizing Human Utility6 Apr
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Visual Instruction Tuningcited by 7,792
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
21 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
- 2025MICo-150K: A Comprehensive Dataset Advancing Multi-Image Compositioncited by 9
- 2025Shining Yourself: High-Fidelity Ornaments Virtual Try-on with Diffusion Modelcited by 6
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
- 2026Can We Perform Online RL for Image Editing without Editing Rewards?
- 2026ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
- 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
- 2026Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation
- 2024Multi-Reward as Condition for Instruction-based Image Editing