mlsanityData to 14 Oct 2026

MILD: Multi-Layer Diffusion Strategy for Complex and Precise Multi-IP Aware Human Erasing

arXiv 2508.06543 ↗First posted 5 Aug 2025cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Recent years have witnessed the success of diffusion models in image customization tasks. However, existing mask-guided human erasing methods still struggle in complex scenarios such as human-human occlusion, human-object entanglement, and human-background interference, mainly due to the lack of large-scale multi-instance datasets and effective spatial decoupling to separate foreground from background. To bridge these gaps, we curate the MILD dataset capturing diverse poses, occlusions, and complex multi-instance interactions. We then define the Cross-Domain Attention Gap (CAG), an attention-gap metric to quantify semantic leakage. On top of these, we propose Multi-Layer Diffusion (MILD), which decomposes the generation process into independent denoising pathways, enabling separate reconstruction of each foreground instance and the background. To enhance human-centric understanding, we introduce Human Morphology Guidance, a plug-and-play module that incorporates pose, parsing, and spatial relationships into the diffusion process to improve structural awareness and restoration quality. Additionally, we present Spatially-Modulated Attention, an adaptive mechanism that leverages spatial mask priors to modulate attention across semantic regions, further widening the CAG to effectively minimize boundary artifacts and mitigate semantic leakage. Experiments show that MILD significantly outperforms existing methods. Datasets and code are publicly available at: https://mild-multi-layer-diffusion.github.io/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 58 of its 72 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

58 of 72 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidance17 Dec
  2. 2024CLIPAway: Harmonizing Focused Embeddings for Removing Objects via Diffusion Models13 Jun
  3. 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion27 Mar
  4. 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Models5 Dec
  5. 2023Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models4 Oct
  6. 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Models6 Apr
  7. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model9 Dec
  8. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2013Auto-Encoding Variational Bayescited by 4,053
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  12. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
38 more
  1. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  3. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  4. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  5. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  6. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  7. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  8. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  9. 2022Blended Latent Diffusioncited by 432
  10. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  11. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  12. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  13. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
  14. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 218
  15. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  16. 2019Self-Correction for Human Parsingcited by 180
  17. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
  18. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
  19. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
  20. 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
  21. 2020Recurrent Feature Reasoning for Image Inpaintingcited by 107
  22. 2019Learning Pyramid-Context Encoder Network for High-Quality Image Inpaintingcited by 94
  23. 2023Improving Tuning-Free Real Image Editing with Proximal Guidancecited by 87
  24. 2023ZONE: Zero-Shot Instruction-Guided Local Editingcited by 62
  25. 2020Layered Neural Rendering for Retiming People in Videocited by 51
  26. 2021SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpaintingcited by 48
  27. 2024GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removalcited by 39
  28. 2022Keys to Better Image Inpainting: Structure and Texture Go Hand in Handcited by 25
  29. 2025SmartEraser: Remove Anything from Images using Masked-Region Guidancecited by 24
  30. 2025RORem: Training a Robust Object Remover with Human-in-the-Loopcited by 23
  31. 2024Source Prompt Disentangled Inversion for Boosting Image Editability with Diffusion Modelscited by 22
  32. 2020Learning Oracle Attention for High-fidelity Face Completioncited by 21
  33. 2022ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priorscited by 21
  34. 2024DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editingcited by 20
  35. 2025Erase Diffusion: Empowering Object Removal Through Calibrating Diffusion Pathwayscited by 18
  36. 2022Image Completion with Heterogeneously Filtered Spectral Hintscited by 17
  37. 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
  38. 2018Deep Structured Energy-Based Image Inpaintingcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removal
  2. 2024ReMOVE: A Reference-free Metric for Object Erasure
  3. 2026Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength
  4. 2024DeCo: Decoupled Human-Centered Diffusion Video Editing with Motion Consistency
  5. 2025Teleportraits: Training-Free People Insertion into Any Scene
  6. 2026PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removal
  7. 2024Enhancing Conditional Image Generation with Explainable Latent Space Manipulation
  8. 2025Stable Diffusion-Based Approach for Human De-Occlusion