mlsanityData to 14 Oct 2026

Learnable Shape Prototypes with Occlusion-Geometry-Guided Injection for Amodal Instance Segmentation

arXiv 2605.24533 ↗First posted 23 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Amodal instance segmentation aims to predict the complete object mask including occluded regions that lack pixel-level observations and must be inferred with the aid of shape priors. Existing methods acquire shape priors through fixed-capacity encoding spaces or expensive generative models, and inject them uniformly across all spatial positions without adapting to the varying prior demand between visible and occluded regions. In this paper, we propose a gated reliability-adaptive shape prior framework, which introduces a shape prior memory module that combines learnable prototypes via cross-attention to produce instance-adaptive shape priors through weighted prototype combination rather than generation. A spatial adaptive reliability gate then employs the signed distance field of the visible mask to modulate injection intensity at each position according to its occlusion depth, preserving reliable features in visible regions while directing shape compensation toward occluded areas. Experiments on two mainstream amodal instance segmentation benchmarks demonstrate that the proposed method outperforms existing approaches under multiple evaluation settings, improving the mean intersection-over-union over occluded regions by over 11 percentage points on one of the two benchmarks under the standard setting, while using approximately one-third of the total parameters. Linear probing analysis further reveals that the visible-mask cross-attention module implicitly encodes occlusion geometry into visual token representations, explaining the effectiveness of the proposed module decomposition.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 68 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

52 of 68 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2023Segment Anythingcited by 8,234
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  9. 2017Mask R-CNNcited by 7,277
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  11. 2017Squeeze-and-Excitation Networkscited by 4,789
  12. 2017Neural Discrete Representation Learningcited by 4,712
38 more
  1. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  4. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  6. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  7. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  8. 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
  9. 2023Vision Transformers Need Registerscited by 871
  10. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  11. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
  12. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  13. 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 344
  14. 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 328
  15. 2022Vision Transformer with Deformable Attentioncited by 295
  16. 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
  17. 2022Focal Modulation Networkscited by 186
  18. 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
  19. 2015Semantic Amodal Segmentationcited by 103
  20. 2020Self-Supervised Scene De-occlusioncited by 96
  21. 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
  22. 2016Amodal Instance Segmentationcited by 63
  23. 2018Learning to See the Invisible: End-to-End Trainable Amodal Instance Segmentationcited by 62
  24. 2017SeGAN: Segmenting and Generating the Invisiblecited by 60
  25. 2020Amodal Segmentation Based on Visible Region Segmentation and Shape Priorcited by 43
  26. 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
  27. 2022Amodal Panoptic Segmentationcited by 38
  28. 2022AISFormer: Amodal Instance Segmentation with Transformercited by 35
  29. 2020Amodal Segmentation through Out-of-Task and Out-of-Distribution Generalization with a Bayesian Modelcited by 29
  30. 2023Coarse-to-Fine Amodal Segmentation with Shape Priorcited by 29
  31. 2021A Weakly Supervised Amodal Segmenter with Boundary Uncertainty Estimationcited by 21
  32. 2024Open-World Amodal Appearance Completioncited by 19
  33. 2019Learning Semantics-aware Distance Map with Semantics Layering Network for Amodal Instance Segmentationcited by 16
  34. 2024Using Diffusion Priors for Video Amodal Segmentationcited by 16
  35. 2023Recurrent Generic Contour-based Instance Segmentation with Progressive Learningcited by 9
  36. 2024BLADE: Box-Level Supervised Amodal Segmentation through Directed Expansioncited by 9
  37. 2025Segment Anything, Even Occludedcited by 7
  38. 2024ShapeFormer: Shape Prior Visible-to-Amodal Transformer-based Amodal Instance Segmentationcited by 6

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.