Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation
Not on the map. Why?
Abstract (arXiv)
Amodal instance segmentation aims to predict the complete object mask including occluded regions that lack pixel-level observations and must be inferred with the aid of shape priors. Existing methods acquire shape priors through fixed-capacity encoding spaces or expensive generative models, and inject them uniformly across all spatial positions without adapting to the varying prior demand between visible and occluded regions. In this paper, we propose a gated reliability-adaptive shape prior framework, which introduces a shape prior memory module that combines learnable prototypes via cross-attention to produce instance-adaptive shape priors through weighted prototype combination rather than generation. A spatial adaptive reliability gate then employs the signed distance field of the visible mask to modulate injection intensity at each position according to its occlusion depth, preserving reliable features in visible regions while directing shape compensation toward occluded areas. Experiments on two mainstream amodal instance segmentation benchmarks demonstrate that the proposed method outperforms existing approaches under multiple evaluation settings, improving the mean intersection-over-union over occluded regions by over 11 percentage points on one of the two benchmarks under the standard setting, while using approximately one-third of the total parameters. Linear probing analysis further reveals that the visible-mask cross-attention module implicitly encodes occlusion geometry into visual token representations, explaining the effectiveness of the proposed module decomposition.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 68 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
52 of 68 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Mask R-CNNcited by 7,277
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2017Neural Discrete Representation Learningcited by 4,712
38 more
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2023Vision Transformers Need Registerscited by 871
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 328
- 2022Vision Transformer with Deformable Attentioncited by 295
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
- 2022Focal Modulation Networkscited by 186
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2015Semantic Amodal Segmentationcited by 103
- 2020Self-Supervised Scene De-occlusioncited by 96
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2016Amodal Instance Segmentationcited by 63
- 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
- 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
- 2020Amodal Segmentation Based on Visible Region Segmentation and Shape Priorcited by 43
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2022Amodal Panoptic Segmentationcited by 38
- 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
- 2020Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Modelcited by 29
- 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
- 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
- 2024Open-World Amodal Appearance Completioncited by 19
- 2019Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentationcited by 16
- 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
- 2023Recurrent Generic Contour-based Instance Segmentation with Progressive Learningcited by 9
- 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansioncited by 9
- 2025Segment Anything, Even Occludedcited by 7
- 2024ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentationcited by 6
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.