OSOR: One-Step Diffusion Inpainting for Effect-Aware Object Removal
Not on the map. Why?
Abstract (arXiv)
Real-world object removal is challenging due to two key difficulties: the target object's non-local effects, such as shadows and reflections, which are difficult to model, and the fact that user-provided masks are often inaccurate or incomplete. With billions of parameters and tens of denoising steps, diffusion-based models achieve strong removal performance at the expense of substantial computational cost, limiting their use in interactive applications and on edge devices. To address these challenges, we present OSOR (One-Step Object Removal), which simultaneously achieves efficient, effect-aware, and mask-robust object removal. Concretely, OSOR introduces: (1) an occupancy-guided discriminator for precise boundary supervision, enabling stable single-step diffusion training; (2) an alpha head that leverages knowledge from pretrained diffusion models to predict appropriate removal regions with minimal overhead, thereby handling imperfect masks; and (3) a semantic-anchored verification pipeline (SAVP) that filters noisy instruction-based triplets to produce effect-aware supervision at scale. Using SAVP, we curate CORNE, which contains 280K verified removal pairs, and further annotate AnimeEraseBench and TextEraseBench to evaluate performance on more complex removal tasks. Experiments show that OSOR surpasses strong multi-step diffusion baselines in perceptual quality while achieving 4× to 30× faster inference.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 39 of its 50 references that are in the map. First posted on arXiv 26 Jun 2026.
Builds on
39 of 50 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,231
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,323
- 2022A ConvNet for the 2020scited by 3,563
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,299
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,921
27 more
- 2023Consistency Modelscited by 1,797
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,427
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,425
- 2022Reproducible scaling laws for contrastive language-image learningcited by 1,164
- 2023One-step Diffusion with Distribution Matching Distillationcited by 991
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 926
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 837
- 2023Adversarial Diffusion Distillationcited by 751
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 733
- 2018Which Training Methods for GANs do actually Converge?cited by 676
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 305
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 217
- 2017Deep Image Mattingcited by 150
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 113
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encodingcited by 83
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 38
- 2025Harnessing Diffusion-Yielded Score Priors for Image Restorationcited by 36
- 2025OmniEraser: Remove Objects and Their Effects in Images with Paired Video-Frame Datacited by 35
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
- 2025SmartEraser: Remove Anything from Images using Masked-Region Guidancecited by 24
- 2024CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Modelscited by 19
- 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 17
- 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Ideal to Real: Stable Video Object Removal under Imperfect Conditions
- 2026Object-WIPER : Training-Free Object and Associated Effect Removal in Videos
- 2026ClickRemoval: An Interactive Open-Source Tool for Object Removal in Diffusion Models
- 2026EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal
- 2026From Understanding to Erasing: Towards Complete and Stable Video Object Removal
- 2024ReMOVE: A Reference-free Metric for Object Erasure
- 2025Mask Consistency Regularization in Object Removal
- 2026EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing