ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL
Not on the map. Why?
Abstract (arXiv)
Recent advances in instruction-based image editing have enabled models to perform complex visual edits from natural language instructions. However, in product-centric scenarios where preserving product features, branding, and textual elements are critical, current open and closed source models often struggle to maintain this fine-grained object identity. This issue is further compounded by the lack of datasets for instruction-based product image editing with text fidelity constraints, leaving it largely treated as an implicit capability of instruction-based image editing models. In this work, we introduce the ProductConsistency dataset which is designed to improve product-centric image editing. Our approach includes a supervised fine-tuning (SFT) dataset of 87k samples for product editing, a reinforcement learning (RL) dataset with 869 unique product images, and a new benchmark dataset, the ProductConsistency Benchmark, to allow rigorous and standardized evaluation of editing models. To guide RL training, we propose a Cyclic Consistency reward that enforces semantic preservation of product identity by using caption similarity between the original product description and captions generated from the edited image. We fine-tune both Qwen-Image-Edit-2511 and Flux.1-Kontext-dev using our dataset and demonstrate consistent improvements over baseline models in OCR and Perceptual metrics, and MLLM-based evaluations as well, indicating stronger product consistency, text rendering, and overall visual quality; with the Qwen-Image-Edit-2511 model achieving a 5x reduction in the character error rate. The code and pipeline is available at https://anonymous.4open.science/r/ProductConsistency-6FCC/README.md
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 56 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
49 of 56 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
37 more
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024OmniGen: Unified Image Generationcited by 394
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 193
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 119
- 2023Prompt Tuning Inversion for Text-Driven Image Editing Using Diffusion Modelscited by 99
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 97
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2022Fine-grained Image Captioning with CLIP Rewardcited by 69
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editingcited by 68
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 62
- 2024MultiBooth: Towards Generating All Your Concepts in an Image from Textcited by 45
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
- 2020Products-10K: A Large-scale Product Recognition Datasetcited by 42
- 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
- 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editingcited by 10
- 2024InstructRL4Pix: Training Diffusion for Image Editing by Reinforcement Learningcited by 7
- 2025PaCo-RL: Advancing Reinforcement Learning for Consistent Image Generation with Pairwise Reward Modelingcited by 7
- 2025R-Genie: Reasoning-Guided Generative Image Editingcited by 6
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editingcited by 6
- 2025Preserving Product Fidelity in Large Scale Image Recontextualization with Diffusion Modelscited by 2
- 2024An Evaluation Framework for Product Images Background Inpainting based on Human Feedback and Product Consistencycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Can We Perform Online RL for Image Editing without Editing Rewards?
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
- 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
- 2026Scalable Minimal-Change Learning for Controllable Image Editing
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing