mlsanityData to 14 Oct 2026

ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL

arXiv 2606.19103 ↗First posted 17 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in instruction-based image editing have enabled models to perform complex visual edits from natural language instructions. However, in product-centric scenarios where preserving product features, branding, and textual elements are critical, current open and closed source models often struggle to maintain this fine-grained object identity. This issue is further compounded by the lack of datasets for instruction-based product image editing with text fidelity constraints, leaving it largely treated as an implicit capability of instruction-based image editing models. In this work, we introduce the ProductConsistency dataset which is designed to improve product-centric image editing. Our approach includes a supervised fine-tuning (SFT) dataset of 87k samples for product editing, a reinforcement learning (RL) dataset with 869 unique product images, and a new benchmark dataset, the ProductConsistency Benchmark, to allow rigorous and standardized evaluation of editing models. To guide RL training, we propose a Cyclic Consistency reward that enforces semantic preservation of product identity by using caption similarity between the original product description and captions generated from the edited image. We fine-tune both Qwen-Image-Edit-2511 and Flux.1-Kontext-dev using our dataset and demonstrate consistent improvements over baseline models in OCR and Perceptual metrics, and MLLM-based evaluations as well, indicating stronger product consistency, text rendering, and overall visual quality; with the Qwen-Image-Edit-2511 model achieving a 5x reduction in the character error rate. The code and pipeline is available at https://anonymous.4open.science/r/ProductConsistency-6FCC/README.md

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

49 of 56 references.

References · 49

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  11. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  12. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
37 more
  1. 2025Qwen-Image Technical Reportcited by 1,044
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  4. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  5. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  7. 2024OmniGen: Unified Image Generationcited by 394
  8. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  9. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  10. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  11. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  12. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  13. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
  14. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
  15. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
  16. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  17. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
  18. 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 99
  19. 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 97
  20. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
  21. 2022Fine-grained Image Captioning with CLIP Rewardcited by 69
  22. 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editingcited by 68
  23. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
  24. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 62
  25. 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
  26. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
  27. 2020Products-10K: A Large-scale Product Recognition Datasetcited by 42
  28. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  29. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
  30. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
  31. 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editingcited by 10
  32. 2024InstructRL4Pix: Training Diffusion for Image Editing by Reinforcement Learningcited by 7
  33. 2025PaCo-RL: Advancing Reinforcement Learning for Consistent Image Generation with Pairwise Reward Modelingcited by 7
  34. 2025R-Genie: Reasoning-Guided Generative Image Editingcited by 6
  35. 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editingcited by 6
  36. 2025Preserving Product Fidelity in Large Scale Image Recontextualization with Diffusion Modelscited by 2
  37. 2024An Evaluation Framework for Product Images Background Inpainting based on Human Feedback and Product Consistencycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can We Perform Online RL for Image Editing without Editing Rewards?
  2. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  3. 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
  4. 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
  5. 2026Scalable Minimal-Change Learning for Controllable Image Editing
  6. 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
  7. 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
  8. 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing