mlsanityData to 13 Oct 2026

SeGAN: Segmenting and Generating the Invisible

arXiv 1703.10239 ↗First posted 29 Mar 2017cs.CVcited by 60

Not on the map. Why?

Abstract (arXiv)

Objects often occlude each other in scenes; Inferring their appearance beyond their visible parts plays an important role in scene understanding, depth estimation, object interaction and manipulation. In this paper, we study the challenging problem of completing the appearance of occluded objects. Doing so requires knowing which pixels to paint (segmenting the invisible parts of objects) and what color to paint them (generating the invisible parts). Our proposed novel solution, SeGAN, jointly optimizes for both segmentation and generation of the invisible parts of objects. Our experimental results show that: (a) SeGAN can learn to generate the appearance of the occluded parts of objects; (b) SeGAN outperforms state-of-the-art segmentation baselines for the invisible parts of objects; (c) trained on synthetic photo realistic images, SeGAN can reliably segment natural images; (d) by reasoning about occluder occludee relations, our method can infer depth layering.

Key facts. Cited by 60 papers in the map (data through 13 Oct 2026). First posted on arXiv 29 Mar 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 9; 2022: 9; 2023: 9; 2024: 18; 2025: 11; 2026: 4.

60 papers.

Sort:

By area:

  1. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 371
  2. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  3. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  4. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  5. 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
  6. 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
  7. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
  8. 2023Amodal Ground Truth and Completion in the Wildcited by 44
  9. 2024MULAN: A Multi Layer Annotated Dataset for Controllable Text-to-Image Generationcited by 38
  10. 20223D Interacting Hand Pose Estimation by Hand De-occlusion and Removalcited by 36
  11. 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
  12. 2021Occlusion-Aware Video Object Inpaintingcited by 30
38 more
  1. 2021Occlusion Handling in Generic Object Detection: A Reviewcited by 25
  2. 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
  3. 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
  4. 2022Image Amodal Completion: A Surveycited by 18
  5. 2024Open-World Amodal Appearance Completioncited by 18
  6. 2024Object-level Scene Deocclusioncited by 17
  7. 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
  8. 2021Spatiotemporal Data Mining: A Survey on Challenges and Open Problemscited by 13
  9. 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Modelcited by 13
  10. 2022Generative Adversarial Networks for Image Super-Resolution: A Surveycited by 11
  11. 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansioncited by 9
  12. 2021Behind the leaves -- Estimation of occluded grapevine berries with conditional generative adversarial networkscited by 8
  13. 2025Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Modelscited by 8
  14. 2023Neural Radiance Field Codebookscited by 7
  15. 2023Amodal Optical Flowcited by 7
  16. 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodallycited by 7
  17. 2025Segment Anything, Even Occludedcited by 7
  18. 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architecturescited by 5
  19. 2023Layout-guided Indoor Panorama Inpainting with Plane-aware Normalizationcited by 5
  20. 2024Amodal Depth Anything: Amodal Depth Estimation in the Wildcited by 4
  21. 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusioncited by 3
  22. 2024This Probably Looks Exactly Like That: An Invertible Prototypical Networkcited by 3
  23. 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAcited by 3
  24. 2025Multi-Agent Amodal Completion: Direct Synthesis with Fine-Grained Semantic Guidancecited by 3
  25. 2026Referring Layer Decompositioncited by 3
  26. 2022GANExplainer: GAN-based Graph Neural Networks Explainercited by 2
  27. 2023Completing Visual Objects via Bridging Generation and Segmentationcited by 2
  28. 2024Segment Any Object Model (SAOM): Real-to-Simulation Fine-Tuning Strategy for Multi-Class Multi-Instance Segmentationcited by 2
  29. 2025SynergyAmodal: Deocclude Anything with Text Controlcited by 2
  30. 2022BBBD: Bounding Box Based Detector for Occlusion Detection and Order Recoverycited by 1
  31. 2023SynTable: A Synthetic Data Generation Pipeline for Unseen Object Amodal Instance Segmentation of Cluttered Tabletop Scenescited by 1
  32. 2023MetaScript: Few-Shot Handwritten Chinese Content Generation via Generative Adversarial Networkscited by 1
  33. 2024Sequential Amodal Segmentation via Cumulative Occlusion Learningcited by 1
  34. 2024Hyper-Transformer for Amodal Completioncited by 1
  35. 2025Stable Diffusion-Based Approach for Human De-Occlusioncited by 1
  36. 2025GPT-4 for Occlusion Order Recoverycited by 1
  37. 2025Reasoning-Driven Amodal Completion: Collaborative Agents and Perceptual Evaluationcited by 1
  38. 2026Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentationcited by 1

50 most cited of 60 All 60 (JSON)