mlsanityData to 14 Oct 2026

Amodal Completion via Progressive Mixed Context Diffusion

arXiv 2312.15540 ↗First posted 24 Dec 2023cs.CVcited by 38

Not on the map. Why?

Abstract (arXiv)

Our brain can effortlessly recognize objects even when partially hidden from view. Seeing the visible of the hidden is called amodal completion; however, this task remains a challenge for generative AI despite rapid progress. We propose to sidestep many of the difficulties of existing approaches, which typically involve a two-step process of predicting amodal masks and then generating pixels. Our method involves thinking outside the box, literally! We go outside the object bounding box to use its context to guide a pre-trained diffusion inpainting model, and then progressively grow the occluded object and trim the extra background. We overcome two technical challenges: 1) how to be free of unwanted co-occurrence bias, which tends to regenerate similar occluders, and 2) how to judge if an amodal completion has succeeded. Our amodal completion method exhibits improved photorealistic completion results compared to existing approaches in numerous successful completion cases. And the best part? It doesn't require any special training or fine-tuning of models.

Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Builds on 42 of its 61 references that are in the map. First posted on arXiv 24 Dec 2023.

Builds on

42 of 61 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  12. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
30 more
  1. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  5. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
  6. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  7. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
  8. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  9. 2023Emergent Correspondence from Image Diffusioncited by 446
  10. 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 388
  11. 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 360
  12. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  13. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
  14. 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
  15. 2019GENESIS: Generative Scene Inference and Sampling with Object-Centric Latent Representationscited by 227
  16. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
  17. 2023Localizing Object-level Shape Variations with Text-to-Image Diffusion Modelscited by 142
  18. 2015Semantic Amodal Segmentationcited by 103
  19. 2023Inst-Inpaint: Instructing to Remove Objects with Diffusion Modelscited by 66
  20. 2016Amodal Instance Segmentationcited by 63
  21. 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
  22. 2023Perceptual Artifacts Localization for Image Synthesis Taskscited by 43
  23. 2023DreamTeacher: Pretraining Image Backbones with Deep Generative Modelscited by 37
  24. 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
  25. 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
  26. 2019Object-Driven Multi-Layer Scene Decomposition From a Single Imagecited by 26
  27. 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
  28. 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
  29. 2019How to make a pizza: Learning a compositional layer-based GAN modelcited by 21
  30. 2019Controllable and Progressive Image Extrapolationcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 9; 2025: 22; 2026: 6.

38 papers.

Sort:

By area:

  1. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  2. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  3. 2024Gen3DSR: Generalizable 3D Scene Reconstruction via Divide and Conquer from a Single Viewcited by 61
  4. 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 54
  5. 2023Amodal Ground Truth and Completion in the Wildcited by 45
  6. 2024Open-World Amodal Appearance Completioncited by 19
  7. 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
  8. 2025DreamLayer: Simultaneous Multi-Layer Generation via Diffusion Modecited by 17
  9. 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
  10. 2024Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Modelscited by 13
  11. 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 10
  12. 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
26 more
  1. 2025DeOcc-1-to-3: 3D De-Occlusion from a Single Image via Self-Supervised Multi-View Diffusioncited by 10
  2. 2025GENA3D: Generative Amodal 3D Modeling by Bridging 2D Priors and 3D Coherencecited by 6
  3. 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimationcited by 5
  4. 2025A Diffusion-Based Framework for Occluded Object Movementcited by 5
  5. 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentationcited by 4
  6. 2024TARGO: Benchmarking Target-driven Object Grasping under Occlusionscited by 3
  7. 2024BLS-GAN: A Deep Layer Separation Framework for Eliminating Bone Overlap in Conventional Radiographscited by 3
  8. 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAcited by 3
  9. 2025Multi-Agent Amodal Completion: Direct Synthesis with Fine-Grained Semantic Guidancecited by 3
  10. 2026EGM: Efficient Visual Grounding Language Modelscited by 3
  11. 2026Referring Layer Decompositioncited by 3
  12. 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
  13. 2025SynergyAmodal: Deocclude Anything with Text Controlcited by 2
  14. 2025CompleteMe: Reference-based Human Image Completioncited by 2
  15. 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Videocited by 1
  16. 2025EscherNet++: Simultaneous Amodal Completion and Scalable View Synthesis through Masked Fine-Tuning and Enhanced Feed-Forward 3D Reconstructioncited by 1
  17. 2025Occlusion-Aware Temporally Consistent Amodal Completion for 3D Human-Object Interaction Reconstructioncited by 1
  18. 2025Contact-Aware Amodal Completion for Human-Object Interaction via Multi-Regional Inpaintingcited by 1
  19. 2025CObL: Toward Zero-Shot Ordinal Layering without User Promptingcited by 1
  20. 2025Stable Diffusion-Based Approach for Human De-Occlusioncited by 1
  21. 2025GPT-4 for Occlusion Order Recoverycited by 1
  22. 2025Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluationcited by 1
  23. 2025Extreme Amodal Face Detectioncited by 0
  24. 2026PHAC: Promptable Human Amodal Completioncited by 0
  25. 2026Integrating Multimodal Large Language Model Knowledge into Amodal Completioncited by 0
  26. 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentationcited by 0