MILD: Multi-Layer Diffusion Strategy for Complex and Precise Multi-IP Aware Human Erasing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Recent years have witnessed the success of diffusion models in image customization tasks. However, existing mask-guided human erasing methods still struggle in complex scenarios such as human-human occlusion, human-object entanglement, and human-background interference, mainly due to the lack of large-scale multi-instance datasets and effective spatial decoupling to separate foreground from background. To bridge these gaps, we curate the MILD dataset capturing diverse poses, occlusions, and complex multi-instance interactions. We then define the Cross-Domain Attention Gap (CAG), an attention-gap metric to quantify semantic leakage. On top of these, we propose Multi-Layer Diffusion (MILD), which decomposes the generation process into independent denoising pathways, enabling separate reconstruction of each foreground instance and the background. To enhance human-centric understanding, we introduce Human Morphology Guidance, a plug-and-play module that incorporates pose, parsing, and spatial relationships into the diffusion process to improve structural awareness and restoration quality. Additionally, we present Spatially-Modulated Attention, an adaptive mechanism that leverages spatial mask priors to modulate attention across semantic regions, further widening the CAG to effectively minimize boundary artifacts and mitigate semantic leakage. Experiments show that MILD significantly outperforms existing methods. Datasets and code are publicly available at: https://mild-multi-layer-diffusion.github.io/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 58 of its 72 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
58 of 72 references.
Closest ancestors · 8
Same direction, newest first
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidance17 Dec
- 2024CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Models13 Jun
- 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar
- 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Models5 Dec
- 2023Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models4 Oct
- 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Models6 Apr
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model9 Dec
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
38 more
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2022Blended Latent Diffusioncited by 432
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2019Self-Correction for Human Parsingcited by 180
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
- 2019Learning Pyramid-Context Encoder Network for High-Quality Image Inpaintingcited by 94
- 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
- 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 62
- 2020Layered Neural Rendering for Retiming People in Videocited by 51
- 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
- 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
- 2022Keys to Better Image Inpainting: Structure and Texture Go Hand in Handcited by 25
- 2025SmartEraser: Remove Anything from Images using Masked-Region Guidancecited by 24
- 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
- 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Modelscited by 22
- 2020Learning Oracle Attention for High-fidelity Face Completioncited by 21
- 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
- 2024DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editingcited by 20
- 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 18
- 2022Image Completion with Heterogeneously Filtered Spectral Hintscited by 17
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
- 2018Deep Structured Energy-Based Image Inpaintingcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removal
- 2024ReMOVE: A Reference-free Metric for Object Erasure
- 2026Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength
- 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistency
- 2025Teleportraits: Training-Free People Insertion into Any Scene
- 2026PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removal
- 2024Enhancing Conditional Image Generation with Explainable Latent Space Manipulation
- 2025Stable Diffusion-Based Approach for Human De-Occlusion