mlsanityData to 7 Oct 2026

Evaluation-Verification Reward for Consistent Multi-Reference Image Editing

arXiv 2607.29025 ↗First posted 31 Jul 2026cs.CVcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency across references and ensuring overall visual harmony. Reinforcement learning has proven highly effective for text-to-image generation and single-image editing, but its extension to multi-reference editing is hindered by the absence of suitable reward models that capture multi-image relational constraints. Moreover, naively using multimodal large language models(MLLMs) as zero-shot evaluators faces a key tension between hallucination-prone long-form reasoning and the limited deductive power of short-form judgments. We address these issues with a Multi-dimensional Evaluation-Verification Reward(EVR). EVR decomposes evaluation into distinct visual criteria; for each criterion, an MLLM Evaluator generates multiple candidate hypotheses, and a Verifier grounds each claim in concrete visual evidence to accept or reject it, producing reliable and fine-grained reward signals. Together with a scalable data pipeline, our method enables RL fine-tuning of off-the-shelf editors without architectural changes. Extensive experiments show substantial gains over the base Qwen-Image-Edit, improving consistency and harmony to match or surpass NanoBanana.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 43 of its 48 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

43 of 48 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedback19 Oct
  2. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
  3. 2025RewardDance: Reward Scaling in Visual Generation10 Sep
  4. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Models6 Aug
  5. 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
  6. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDE29 Jul
  7. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  8. 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
  9. 2024Aligning Diffusion Models by Optimizing Human Utility6 Apr
  10. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  6. 2023Visual Instruction Tuningcited by 7,792
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  10. 2022Flow Matching for Generative Modelingcited by 5,426
  11. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
21 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  4. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  6. 2025Qwen-Image Technical Reportcited by 973
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  9. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  11. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  12. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  13. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  14. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  15. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  16. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  17. 2025Seedream 3.0 Technical Reportcited by 146
  18. 2025Advantage Weighted Matching: Aligning RL with Pretraining in Diffusion Modelscited by 59
  19. 2025MICo-150K: A Comprehensive Dataset Advancing Multi-Image Compositioncited by 9
  20. 2025Shining Yourself: High-Fidelity Ornaments Virtual Try-on with Diffusion Modelcited by 6
  21. 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Trust Your Critic: Robust Reward Modeling and Reinforcement Learning for Faithful Image Editing and Generation
  2. 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
  3. 2026Can We Perform Online RL for Image Editing without Editing Rewards?
  4. 2026ReasonEdit: Towards Interpretable Image Editing Evaluation via Reinforcement Learning
  5. 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
  6. 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
  7. 2026Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation
  8. 2024Multi-Reward as Condition for Instruction-based Image Editing