PredErase: Training-Free Object-and-Effect Removal with Predictive Latent Guidance
Not on the map. Why?
Abstract (arXiv)
Removing an object is not the same as filling its mask. Cast shadows and contact shading usually lie outside the user-provided instance mask M_obj, so a frozen Fill model that edits only that mask leaves the object's photometric footprint on nearby surfaces. Supervised removers learn this joint erasure from paired clean plates. Training-free editors freeze pretrained weights, yet most still treat M_obj as the entire editable support and steer sampling with CLIP or DINO energies that do not predict the occluded scene. We present PredErase, a training-free inference procedure on frozen FLUX.2 and I-JEPA. The method separates where Fill may rewrite pixels from what structure should occupy the hole. A contact-band expansion M_flux of M_obj exposes local residuals on the supporting plane. I-JEPA, pretrained for masked token prediction, supplies a context-conditioned hole target in representation space; sparse projected gradients align decoded Fill completions with that target inside the instance, while coordinates outside the packed support stay locked. Under instance-only masks on RemovalBench, RORD-Val, and DEFACTO-Val, PredErase improves the native FLUX.2 backbone. Supervised removers remain stronger on several full-image appearance metrics; the supported claim is training-free object-and-effect editing of frozen Fill, not replacement of paired-data erasers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
34 of 43 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
22 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2023Rethinking FID: Towards a Better Evaluation Metric for Image Generationcited by 310
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021From Shadow Generation to Shadow Removalcited by 55
- 2019Instance Shadow Detectioncited by 37
- 2025OmniEraser: Remove Objects and Their Effects in Images with Paired Video-Frame Datacited by 37
- 2025SmartEraser: Remove Anything from Images using Masked-Region Guidancecited by 24
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2025Precise Object and Effect Removal with Adaptive Target-Aware Attentioncited by 13
- 2013Shadow Detection: A Survey and Comparative Evaluation of Recent Methodscited by 10
- 2024MetaShadow: Object-Centered Shadow Detection, Removal, and Synthesiscited by 5
Built on by
Not cited yet.