Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Semantic amodal segmentation is a recently proposed extension to instance-aware segmentation that includes the prediction of the invisible region of each object instance. We present the first all-in-one end-to-end trainable model for semantic amodal segmentation that predicts the amodal instance masks as well as their visible and invisible part in a single forward pass. In a detailed analysis, we provide experiments to show which architecture choices are beneficial for an all-in-one amodal segmentation model. On the COCO amodal dataset, our model outperforms the current baseline for amodal segmentation by a large margin. To further evaluate our model, we provide two new datasets with ground truth for semantic amodal segmentation, D2S amodal and COCOA cls. For both datasets, our model provides a strong baseline performance. Using special data augmentation techniques, we show that amodal segmentation on D2S amodal is possible with reasonable performance, even without providing amodal training data.
Key facts. Cited by 62 papers in the map (data through 13 Oct 2026). First posted on arXiv 24 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 9; 2024: 17; 2025: 13; 2026: 5.
62 papers.
Sort:
By area:
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2023Amodal Ground Truth and Completion in the Wildcited by 44
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2022Amodal Panoptic Segmentationcited by 37
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
- 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentationcited by 27
- 2021Occlusion Handling in Generic Object Detection: A Reviewcited by 25
- 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
38 more
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2022A Tri-Layer Plugin to Improve Occluded Detectioncited by 21
- 2022Perceiving the Invisible: Proposal-Free Amodal Panoptic Segmentationcited by 20
- 2022Image Amodal Completion: A Surveycited by 18
- 2024Open-World Amodal Appearance Completioncited by 18
- 2023DoNet: Deep De-overlapping Network for Cytology Instance Segmentationcited by 17
- 2024Object-level Scene Deocclusioncited by 17
- 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
- 2022Self-supervised Amodal Video Object Segmentationcited by 14
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2022Amodal Cityscapes: A New Dataset, its Generation, and an Amodal Semantic Segmentation Challenge Baselinecited by 12
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2023Recurrent Generic Contour-based Instance Segmentation with Progressive Learningcited by 9
- 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansioncited by 9
- 2025Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Modelscited by 8
- 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodallycited by 7
- 2025Segment Anything, Even Occludedcited by 7
- 2024ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentationcited by 6
- 2024Occlusion-Aware Seamless Segmentationcited by 6
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architecturescited by 5
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimationcited by 5
- 2023Neural Textured Deformable Meshes for Robust Analysis-by-Synthesiscited by 4
- 2024PLUG: Revisiting Amodal Segmentation with Foundation Model and Hierarchical Focuscited by 4
- 2021Amodal segmentation just like doing a jigsawcited by 3
- 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusioncited by 3
- 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURAcited by 3
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentationcited by 3
- 2024GAInS: Gradient Anomaly-aware Biomedical Instance Segmentationcited by 2
- 2025SynergyAmodal: Deocclude Anything with Text Controlcited by 2
- 2026Amodal SAM: A Unified Amodal Segmentation Framework with Generalizationcited by 2
- 2023Amodal Intra-class Instance Segmentation: Synthetic Datasets and Benchmarkcited by 1
- 2023SynTable: A Synthetic Data Generation Pipeline for Unseen Object Amodal Instance Segmentation of Cluttered Tabletop Scenescited by 1
- 2024Sequential Amodal Segmentation via Cumulative Occlusion Learningcited by 1
- 2024Hyper-Transformer for Amodal Completioncited by 1
- 2024Foundation Models for Amodal Video Instance Segmentation in Automated Drivingcited by 1
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Videocited by 1
- 2025Shape Distribution Matters: Shape-specific Mixture-of-Experts for Amodal Segmentation under Diverse Occlusionscited by 1
- 2025CObL: Toward Zero-Shot Ordinal Layering without User Promptingcited by 1
50 most cited of 62 All 62 (JSON)
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation23 May 2026
- 2026Amodal SAM: A Unified Amodal Segmentation Framework with Generalization22 Apr 2026
- 2026Seeing Through the Tool: A Controlled Benchmark for Occlusion Robustness in Foundation Segmentation Models13 Apr 2026
- 2026PHAC: Promptable Human Amodal Completion16 Mar 2026
- 2025ViTA-Seg: Vision Transformer for Amodal Segmentation in Robotics10 Dec 2025
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug 2025
- 2025CObL: Toward Zero-Shot Ordinal Layering without User Prompting11 Aug 2025
- 2025Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Models6 Aug 2025
- 2025Shape Distribution Matters: Shape-specific Mixture-of-Experts for Amodal Segmentation under Diverse Occlusions3 Aug 2025
- 2025Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation3 Aug 2025
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Video1 Jul 2025
38 more
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentation26 Jun 2025
- 2025R2SM: Referring and Reasoning for Selective Masks2 Jun 2025
- 2025SynergyAmodal: Deocclude Anything with Text Control28 Apr 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025Unveiling the Invisible: Reasoning Complex Occlusions Amodally with AURA13 Mar 2025
- 2025Segment Anything, Even Occluded8 Mar 2025
- 2024Using Diffusion Priors for Video Amodal Segmentation5 Dec 2024
- 2024A2VIS: Amodal-Aware Approach to Video Instance Segmentation2 Dec 2024
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation28 Nov 2024
- 2024A Bilayer Segmentation-Recombination Network for Accurate Segmentation of Overlapping C. elegans26 Nov 2024
- 2024Open-World Amodal Appearance Completion20 Nov 2024
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimation26 Sep 2024
- 2024Foundation Models for Amodal Video Instance Segmentation in Automated Driving21 Sep 2024
- 2024GAInS: Gradient Anomaly-aware Biomedical Instance Segmentation21 Sep 2024
- 2024Amodal Segmentation for Laparoscopic Surgery Video Instruments2 Aug 2024
- 2024Occlusion-Aware Seamless Segmentation2 Jul 2024
- 2024Object-level Scene Deocclusion11 Jun 2024
- 2024Hyper-Transformer for Amodal Completion30 May 2024
- 2024PLUG: Revisiting Amodal Segmentation with Foundation Model and Hierarchical Focus25 May 2024
- 2024Sequential Amodal Segmentation via Cumulative Occlusion Learning9 May 2024
- 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusion27 Mar 2024
- 2024ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentation18 Mar 2024
- 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansion3 Jan 2024
- 2023Amodal Ground Truth and Completion in the Wild28 Dec 2023
- 2023TAO-Amodal: A Benchmark for Tracking Any Object Amodally19 Dec 2023
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Driving12 Sep 2023
- 2023Coarse-to-Fine Amodal Segmentation with Shape Prior31 Aug 2023
- 2023SynTable: A Synthetic Data Generation Pipeline for Unseen Object Amodal Instance Segmentation of Cluttered Tabletop Scenes14 Jul 2023
- 2023Neural Textured Deformable Meshes for Robust Analysis-by-Synthesis31 May 2023
- 2023DoNet: Deep De-overlapping Network for Cytology Instance Segmentation25 Mar 2023
- 2023Amodal Intra-class Instance Segmentation: Synthetic Datasets and Benchmark12 Mar 2023
- 2023Recurrent Generic Contour-based Instance Segmentation with Progressive Learning21 Jan 2023
- 2022Self-supervised Amodal Video Object Segmentation23 Oct 2022
- 2022A Tri-Layer Plugin to Improve Occluded Detection18 Oct 2022
- 2022AISFormer: Amodal Instance Segmentation with Transformer12 Oct 2022
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architectures8 Aug 2022
- 2022Image Amodal Completion: A Survey5 Jul 2022
- 2022Amodal Cityscapes: A New Dataset, its Generation, and an Amodal Semantic Segmentation Challenge Baseline1 Jun 2022
50 newest of 62 All 62 (JSON)
- 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimationcited by 5
- 2025SynergyAmodal: Deocclude Anything with Text Controlcited by 2
- 2025Stable Diffusion-Based Approach for Human De-Occlusioncited by 1
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentationcited by 0
- 2026PHAC: Promptable Human Amodal Completioncited by 0
- 2026PHAC: Promptable Human Amodal Completion16 Mar 2026
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug 2025
- 2025SynergyAmodal: Deocclude Anything with Text Control28 Apr 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2024Using Diffusion Priors for Video Amodal Segmentation5 Dec 2024
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation28 Nov 2024
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimation26 Sep 2024
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2023Amodal Ground Truth and Completion in the Wildcited by 44
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2022Amodal Panoptic Segmentationcited by 37
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
- 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentationcited by 27
- 2021Occlusion Handling in Generic Object Detection: A Reviewcited by 25
- 2021Visiting the Invisible: Layer-by-Layer Completed Scene Decompositioncited by 23
12 most cited of 51 All 51 (JSON)
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation23 May 2026
- 2026Amodal SAM: A Unified Amodal Segmentation Framework with Generalization22 Apr 2026
- 2026Seeing Through the Tool: A Controlled Benchmark for Occlusion Robustness in Foundation Segmentation Models13 Apr 2026
- 2025ViTA-Seg: Vision Transformer for Amodal Segmentation in Robotics10 Dec 2025
- 2025CObL: Toward Zero-Shot Ordinal Layering without User Prompting11 Aug 2025
- 2025Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation3 Aug 2025
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Video1 Jul 2025
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentation26 Jun 2025
- 2025Segment Anything, Even Occluded8 Mar 2025
- 2024A2VIS: Amodal-Aware Approach to Video Instance Segmentation2 Dec 2024
- 2024A Bilayer Segmentation-Recombination Network for Accurate Segmentation of Overlapping C. elegans26 Nov 2024
12 newest of 51 All 51 (JSON)