Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayers
Not on the map. Why?
Abstract (arXiv)
Segmenting highly-overlapping objects is challenging, because typically no distinction is made between real object contours and occlusion boundaries. Unlike previous two-stage instance segmentation methods, we model image formation as composition of two overlapping layers, and propose Bilayer Convolutional Network (BCNet), where the top GCN layer detects the occluding objects (occluder) and the bottom GCN layer infers partially occluded instance (occludee). The explicit modeling of occlusion relationship with bilayer structure naturally decouples the boundaries of both the occluding and occluded instances, and considers the interaction between them during mask regression. We validate the efficacy of bilayer decoupling on both one-stage and two-stage object detectors with different backbones and network layer choices. Despite its simplicity, extensive experiments on COCO and KINS show that our occlusion-aware BCNet achieves large and consistent performance gain especially for heavy occlusion cases. Code is available at https://github.com/lkeab/BCNet.
Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). Builds on 48 of its 64 references that are in the map. First posted on arXiv 23 Mar 2021.
Builds on
48 of 64 references.
References · 48
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Layer Normalizationcited by 5,579
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2017Non-local Neural Networkscited by 2,290
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
- 2018Path Aggregation Network for Instance Segmentationcited by 796
36 more
- 2019Hybrid Task Cascade for Instance Segmentationcited by 479
- 2019YOLACT: Real-time Instance Segmentationcited by 441
- 2019SOLO: Segmenting Objects by Locationscited by 289
- 2019Mask Scoring R-CNNcited by 265
- 2018Videos as Space-Time Region Graphscited by 221
- 2019CenterMask : Real-Time Anchor-Free Instance Segmentationcited by 200
- 2019PolarMask: Single Shot Instance Segmentation with Polar Representationcited by 188
- 2020BlendMask: Top-Down Meets Bottom-Up for Instance Segmentationcited by 144
- 2014Hypercolumns for Object Segmentation and Fine-grained Localizationcited by 128
- 2016Fully Convolutional Instance-aware Semantic Segmentationcited by 122
- 2015Instance-aware Semantic Segmentation via Multi-task Network Cascadescited by 120
- 2018Graph-Based Global Reasoning Networkscited by 120
- 2015Semantic Amodal Segmentationcited by 102
- 2019TensorMask: A Foundation for Dense Object Segmentationcited by 101
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2016Deep Watershed Transform for Instance Segmentationcited by 77
- 2020Boundary-preserving Mask R-CNNcited by 74
- 2016Learning to Refine Object Segmentscited by 67
- 2019AdaptIS: Adaptive Instance Selection Networkcited by 64
- 2016Amodal Instance Segmentationcited by 63
- 2017Repulsion Loss: Detecting Pedestrians in a Crowdcited by 62
- 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
- 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
- 2019Dual Graph Convolutional Network for Semantic Segmentationcited by 59
- 2018Occlusion-aware R-CNN: Detecting Pedestrians in a Crowdcited by 58
- 2017Recurrent Pixel Embedding for Instance Groupingcited by 57
- 2017MaskLab: Instance Segmentation by Refining Object Detection with Semantic and Direction Featurescited by 54
- 2016InstanceCut: from Edges to Instances with MultiCutcited by 48
- 2019ShapeMask: Learning to Segment Novel Objects by Refining Shape Priorscited by 42
- 2019Learning Instance Occlusion for Panoptic Segmentationcited by 30
- 2020GSNet: Joint Vehicle Pose and Shape Reconstruction with Geometrical and Scene-aware Supervisioncited by 28
- 2018Affinity Derivation and Graph Merge for Instance Segmentationcited by 25
- 2019Visualizing the Invisible: Occluded Vehicle Segmentation and Recoverycited by 24
- 2017Pixelwise Instance Segmentation with a Dynamically Instantiated Networkcited by 20
- 2015Iterative Instance Segmentationcited by 19
- 2014Parsing Occluded People by Flexible Compositionscited by 8
Built on by
Citing papers per year: 2021: 20; 2022: 15; 2023: 17; 2024: 23; 2025: 20; 2026: 9.
104 papers.
Sort:
By area:
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2021Instances as Queriescited by 157
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2021Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentationcited by 43
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2022Amodal Panoptic Segmentationcited by 37
- 2022DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotationscited by 35
38 more
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2023Robustness of SAM: Segment Anything Under Corruptions and Beyondcited by 30
- 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
- 2022Video Mask Transfiner for High-Quality Video Instance Segmentationcited by 28
- 2022Human Instance Matting via Mutual Guidance and Multi-Instance Refinementcited by 25
- 2023Learning Environment-Aware Affordance for 3D Articulated Object Manipulation under Occlusionscited by 23
- 2021Rank & Sort Loss for Object Detection and Instance Segmentationcited by 22
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2022A Tri-Layer Plugin to Improve Occluded Detectioncited by 21
- 2022Perceiving the Invisible: Proposal-Free Amodal Panoptic Segmentationcited by 20
- 2023Mask-Free Video Instance Segmentationcited by 20
- 2022ContrastMask: Contrastive Learning to Segment Every Thingcited by 19
- 2022Image Amodal Completion: A Surveycited by 18
- 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
- 2022Learning Equivariant Segmentation with Instance-Unique Queryingcited by 17
- 2024Object-level Scene Deocclusioncited by 17
- 2023DoNet: Deep De-overlapping Network for Cytology Instance Segmentationcited by 16
- 2024Using Diffusion Priors for Video Amodal Segmentationcited by 15
- 2021A Unified Efficient Pyramid Transformer for Semantic Segmentationcited by 14
- 2023MDQE: Mining Discriminative Query Embeddings to Segment Occluded Instances on Challenging Videoscited by 13
- 2023AmodalSynthDrive: A Synthetic Amodal Perception Dataset for Autonomous Drivingcited by 13
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenescited by 13
- 2022Amodal Cityscapes: A New Dataset, its Generation, and an Amodal Semantic Segmentation Challenge Baselinecited by 12
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
- 2024Trapped in texture bias? A large scale comparison of deep instance segmentationcited by 10
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluationcited by 10
- 2021BI-GCN: Boundary-Aware Input-Dependent Graph Convolution Network for Biomedical Image Segmentationcited by 9
- 2023Rethinking Amodal Video Segmentation from Learning Supervised Signals with Object-centric Representationcited by 9
- 2021Benchmarking the Robustness of Instance Segmentation Modelscited by 8
- 2023PatchDCT: Patch Refinement for High Quality Instance Segmentationcited by 8
- 2024Object-level Geometric Structure Preserving for Natural Image Stitchingcited by 8
- 2025Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Modelscited by 8
- 2021Weak-shot Semantic Segmentation by Transferring Semantic Affinity and Boundarycited by 7
- 2023O2RNet: Occluder-Occludee Relational Network for Robust Apple Detection in Clustered Orchard Environmentscited by 7
- 2025Segment Anything, Even Occludedcited by 7
50 most cited of 104 All 104 (JSON)
- 2026EgoMaize: A First-Person Maize Instance Segmentation Benchmark under Severe Field Occlusion11 Sep 2026
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026ELDiff: When Evidential Learning Meets Text-to-Image Diffusion18 Jun 2026
- 2026A Turbo-Inference Strategy for Object Detection and Instance Segmentation10 Jun 2026
- 2026Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation23 May 2026
- 2026Seeing Through the Tool: A Controlled Benchmark for Occlusion Robustness in Foundation Segmentation Models13 Apr 2026
- 2026PHAC: Promptable Human Amodal Completion16 Mar 2026
- 2026PICS: Pairwise Image Compositing with Spatial Interactions6 Mar 2026
- 2025Weak-to-Strong Generalization Enables Fully Automated De Novo Training of Multi-head Mask-RCNN Model for Segmenting Densely Overlapping Cell Nuclei in Multiplex Whole-slice Brain Images12 Dec 2025
- 2025Illustrator's Depth: Monocular Layer Index Prediction for Image Decomposition21 Nov 2025
- 2025Overlap-aware segmentation for topological reconstruction of obscured objects7 Oct 2025
38 more
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug 2025
- 2025CObL: Toward Zero-Shot Ordinal Layering without User Prompting11 Aug 2025
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Rendering11 Aug 2025
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Models6 Aug 2025
- 2025Shape Distribution Matters: Shape-specific Mixture-of-Experts for Amodal Segmentation under Diverse Occlusions3 Aug 2025
- 2025Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation3 Aug 2025
- 2025Contact-Aware Amodal Completion for Human-Object Interaction via Multi-Regional Inpainting1 Aug 2025
- 2025Training for X-Ray Vision: Amodal Segmentation, Amodal Content Completion, and View-Invariant Object Representation from Multi-Camera Video1 Jul 2025
- 2025Prohibited Items Segmentation via Occlusion-aware Bilayer Modeling13 Jun 2025
- 2025MP-Mat: A 3D-and-Instance-Aware Human Matting and Editing Framework with Multiplane Representation20 Apr 2025
- 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation17 Apr 2025
- 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluation13 Apr 2025
- 2025HoloPart: Generative 3D Part Amodal Segmentation10 Apr 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025Segment Anything, Even Occluded8 Mar 2025
- 2025DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion23 Feb 2025
- 2024Using Diffusion Priors for Video Amodal Segmentation5 Dec 2024
- 2024Amodal Depth Anything: Amodal Depth Estimation in the Wild3 Dec 2024
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation28 Nov 2024
- 2024A Bilayer Segmentation-Recombination Network for Accurate Segmentation of Overlapping C. elegans26 Nov 2024
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimation26 Sep 2024
- 2024Foundation Models for Amodal Video Instance Segmentation in Automated Driving21 Sep 2024
- 2024COCO-OLAC: A Benchmark for Occluded Panoptic Segmentation and Image Understanding19 Sep 2024
- 2024Improving Weakly-supervised Video Instance Segmentation by Leveraging Spatio-temporal Consistency29 Aug 2024
- 2024Amodal Segmentation for Laparoscopic Surgery Video Instruments2 Aug 2024
- 2024Hybrid Deep Learning-Based for Enhanced Occlusion Segmentation in PICU Patient Monitoring18 Jul 2024
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes16 Jul 2024
- 2024Occlusion-Aware Seamless Segmentation2 Jul 2024
- 2024Learning from Exemplars for Interactive Image Segmentation17 Jun 2024
- 2024Object-level Scene Deocclusion11 Jun 2024
- 2024Hyper-Transformer for Amodal Completion30 May 2024
- 2024PLUG: Revisiting Amodal Segmentation with Foundation Model and Hierarchical Focus25 May 2024
- 2024Deep video representation learning: a survey10 May 2024
- 2024Sequential Amodal Segmentation via Cumulative Occlusion Learning9 May 2024
- 2024WALT3D: Generating Realistic Training Data from Time-Lapse Imagery for Reconstructing Dynamic Objects under Occlusion27 Mar 2024
- 2024ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentation18 Mar 2024
- 2024Object-level Geometric Structure Preserving for Natural Image Stitching20 Feb 2024
50 newest of 104 All 104 (JSON)
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2024Using Diffusion Priors for Video Amodal Segmentationcited by 15
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimationcited by 5
- 2025Contact-Aware Amodal Completion for Human-Object Interaction via Multi-Regional Inpaintingcited by 1
- 2025Stable Diffusion-Based Approach for Human De-Occlusioncited by 1
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentationcited by 0
- 2026PICS: Pairwise Image Compositing with Spatial Interactionscited by 0
- 2026PHAC: Promptable Human Amodal Completioncited by 0
- 2026ELDiff: When Evidential Learning Meets Text-to-Image Diffusioncited by 0
- 2026ELDiff: When Evidential Learning Meets Text-to-Image Diffusion18 Jun 2026
- 2026PHAC: Promptable Human Amodal Completion16 Mar 2026
- 2026PICS: Pairwise Image Compositing with Spatial Interactions6 Mar 2026
- 2025Stable Diffusion-Based Approach for Human De-Occlusion18 Aug 2025
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Rendering11 Aug 2025
- 2025Contact-Aware Amodal Completion for Human-Object Interaction via Multi-Regional Inpainting1 Aug 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2024Using Diffusion Priors for Video Amodal Segmentation5 Dec 2024
- 2024Track Anything Behind Everything: Zero-Shot Amodal Video Object Segmentation28 Nov 2024
- 2024Amodal Instance Segmentation with Diffusion Shape Prior Estimation26 Sep 2024
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholes25 Jan 2024
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2021Instances as Queriescited by 157
- 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2021Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentationcited by 43
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2022Amodal Panoptic Segmentationcited by 37
- 2022DeepSportradar-v1: Computer Vision Dataset for Sports Understanding with High Quality Annotationscited by 35
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
12 most cited of 90 All 90 (JSON)
- 2026EgoMaize: A First-Person Maize Instance Segmentation Benchmark under Severe Field Occlusion11 Sep 2026
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Occlusion-Aware Panoptic Segmentation with Joint Position Embedding and Occlusion-Level Attention20 Jul 2026
- 2026A Turbo-Inference Strategy for Object Detection and Instance Segmentation10 Jun 2026
- 2026Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation23 May 2026
- 2026Seeing Through the Tool: A Controlled Benchmark for Occlusion Robustness in Foundation Segmentation Models13 Apr 2026
- 2025Weak-to-Strong Generalization Enables Fully Automated De Novo Training of Multi-head Mask-RCNN Model for Segmenting Densely Overlapping Cell Nuclei in Multiplex Whole-slice Brain Images12 Dec 2025
- 2025Illustrator's Depth: Monocular Layer Index Prediction for Image Decomposition21 Nov 2025
- 2025Overlap-aware segmentation for topological reconstruction of obscured objects7 Oct 2025
- 2025CObL: Toward Zero-Shot Ordinal Layering without User Prompting11 Aug 2025
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025Single Point, Full Mask: Velocity-Guided Level Set Evolution for End-to-End Amodal Segmentation3 Aug 2025
12 newest of 90 All 90 (JSON)