mlsanityData to 7 Oct 2026

Open-World Amodal Appearance Completion

arXiv 2411.13019 ↗First posted 20 Nov 2024cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Understanding and reconstructing occluded objects is a challenging problem, especially in open-world scenarios where categories and contexts are diverse and unpredictable. Traditional methods, however, are typically restricted to closed sets of object categories, limiting their use in complex, open-world scenes. We introduce Open-World Amodal Appearance Completion, a training-free framework that expands amodal completion capabilities by accepting flexible text queries as input. Our approach generalizes to arbitrary objects specified by both direct terms and abstract queries. We term this capability reasoning amodal completion, where the system reconstructs the full appearance of the queried object based on the provided image and language query. Our framework unifies segmentation, occlusion analysis, and inpainting to handle complex occlusions and generates completed objects as RGBA elements, enabling seamless integration into applications such as 3D reconstruction and image editing. Extensive evaluations demonstrate the effectiveness of our approach in generalizing to novel objects and occlusions, establishing a new benchmark for amodal completion in open-world settings. The code and datasets will be released after paper acceptance.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 20 Nov 2024.

Builds on

34 of 45 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2023Segment Anythingcited by 8,158
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  6. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  9. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  10. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
  11. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 704
  12. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
22 more
  1. 2023VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Taskscited by 499
  2. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  3. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
  4. 2015Semantic Amodal Segmentationcited by 102
  5. 2020Self-Supervised Scene De-occlusioncited by 96
  6. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  7. 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 69
  8. 2023Open-Set Image Tagging with Multi-Grained Text Supervisioncited by 67
  9. 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
  10. 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
  11. 2023Amodal Ground Truth and Completion in the Wildcited by 43
  12. 2023Amodal Completion via Progressive Mixed Context Diffusioncited by 38
  13. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  14. 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
  15. 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
  16. 2019Object-Driven Multi-Layer Scene Decomposition From a Single Imagecited by 26
  17. 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
  18. 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
  19. 2019How to make a pizza: Learning a compositional layer-based GAN modelcited by 21
  20. 2022Image Amodal Completion: A Surveycited by 18
  21. 2024Object-level Scene Deocclusioncited by 17
  22. 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 10.

18 papers.

Sort:

By area: