RePainter: Empowering E-commerce Object Removal via Spatial-matting Reinforcement Learning
On the map: LLM safety and security → Vision-language and text-to-image safety
Abstract (arXiv)
In web data, product images are central to boosting user engagement and advertising efficacy on e-commerce platforms, yet the intrusive elements such as watermarks and promotional text remain major obstacles to delivering clear and appealing product visuals. Although diffusion-based inpainting methods have advanced, they still face challenges in commercial settings due to unreliable object removal and limited domain-specific adaptation. To tackle these challenges, we propose Repainter, a reinforcement learning framework that integrates spatial-matting trajectory refinement with Group Relative Policy Optimization (GRPO). Our approach modulates attention mechanisms to emphasize background context, generating higher-reward samples and reducing unwanted object insertion. We also introduce a composite reward mechanism that balances global, local, and semantic constraints, effectively reducing visual artifacts and reward hacking. Additionally, we contribute EcomPaint-100K, a high-quality, large-scale e-commerce inpainting dataset, and a standardized benchmark EcomPaint-Bench for fair evaluation. Extensive experiments demonstrate that Repainter significantly outperforms state-of-the-art methods, especially in challenging scenes with intricate compositions. We will release our code and weights upon acceptance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 42 of its 67 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
42 of 67 references.
References · 42
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
30 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
- 2025Seedream 3.0 Technical Reportcited by 146
- 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2025QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learningcited by 46
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 38
- 2025OmniEraser: Remove Objects and Their Effects in Images with Paired Video-Frame Datacited by 35
- 2024Open-Vocabulary Attention Maps with Token Optimization for Semantic Segmentation in Diffusion Modelscited by 29
- 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 28
- 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learningcited by 22
- 2024CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Modelscited by 19
- 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 17
- 2024MagicEraser: Erasing Any Objects via Semantics-Aware Controlcited by 15
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All
- 2025DreamPainter: Image Background Inpainting for E-commerce Scenarios
- 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preference
- 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning
- 2026Follow-Your-Preference++: Rethinking Preference Alignment for Image Inpainting
- 2024E-Commerce Inpainting with Mask Guidance in Controlnet for Reducing Overcompletion
- 2026Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model
- 2026Element-Aware Group Learning for E-Commerce Image Generation