mlsanityData to 7 Oct 2026

RePainter: Empowering E-commerce Object Removal via Spatial-matting Reinforcement Learning

arXiv 2510.07721 ↗First posted 9 Oct 2025cs.CVcited by 3

On the map: LLM safety and security → Vision-language and text-to-image safety

Abstract (arXiv)

In web data, product images are central to boosting user engagement and advertising efficacy on e-commerce platforms, yet the intrusive elements such as watermarks and promotional text remain major obstacles to delivering clear and appealing product visuals. Although diffusion-based inpainting methods have advanced, they still face challenges in commercial settings due to unreliable object removal and limited domain-specific adaptation. To tackle these challenges, we propose Repainter, a reinforcement learning framework that integrates spatial-matting trajectory refinement with Group Relative Policy Optimization (GRPO). Our approach modulates attention mechanisms to emphasize background context, generating higher-reward samples and reducing unwanted object insertion. We also introduce a composite reward mechanism that balances global, local, and semantic constraints, effectively reducing visual artifacts and reward hacking. Additionally, we contribute EcomPaint-100K, a high-quality, large-scale e-commerce inpainting dataset, and a standardized benchmark EcomPaint-Bench for fair evaluation. Extensive experiments demonstrate that Repainter significantly outperforms state-of-the-art methods, especially in challenging scenes with intricate compositions. We will release our code and weights upon acceptance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Vision-language and text-to-image safety, one of 12 directions in LLM safety and security. Builds on 42 of its 67 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

42 of 67 references.

References · 42

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  10. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  11. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  12. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
30 more
  1. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  2. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  4. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  6. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  7. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  8. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  9. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  10. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  11. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  12. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
  13. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  14. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
  15. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  16. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  17. 2023Dense Text-to-Image Generation with Attention Modulationcited by 162
  18. 2025Seedream 3.0 Technical Reportcited by 146
  19. 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
  20. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
  21. 2025QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement Learningcited by 46
  22. 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 38
  23. 2025OmniEraser: Remove Objects and Their Effects in Images with Paired Video-Frame Datacited by 35
  24. 2024Open-Vocabulary Attention Maps with Token Optimization for Semantic Segmentation in Diffusion Modelscited by 29
  25. 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 28
  26. 2025OneReward: Unified Mask-Guided Image Generation via Multi-Task Human Preference Learningcited by 22
  27. 2024CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Modelscited by 19
  28. 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 17
  29. 2024MagicEraser: Erasing Any Objects via Semantics-Aware Controlcited by 15
  30. 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All
  2. 2025DreamPainter: Image Background Inpainting for E-commerce Scenarios
  3. 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preference
  4. 2026CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning
  5. 2026Follow-Your-Preference++: Rethinking Preference Alignment for Image Inpainting
  6. 2024E-Commerce Inpainting with Mask Guidance in Controlnet for Reducing Overcompletion
  7. 2026Training-Free Inpainting Across Domains with a Frozen Text-to-Image Diffusion Model
  8. 2026Element-Aware Group Learning for E-Commerce Image Generation