mlsanityData to 7 Oct 2026

BoxSnake: Polygonal Instance Segmentation with Box Supervision

arXiv 2303.11630 ↗First posted 21 Mar 2023cs.CV cs.AIcited by 12

Not on the map. Why?

Abstract (arXiv)

Box-supervised instance segmentation has gained much attention as it requires only simple box annotations instead of costly mask or polygon annotations. However, existing box-supervised instance segmentation models mainly focus on mask-based frameworks. We propose a new end-to-end training technique, termed BoxSnake, to achieve effective polygonal instance segmentation using only box annotations for the first time. Our method consists of two loss functions: (1) a point-based unary loss that constrains the bounding box of predicted polygons to achieve coarse-grained segmentation; and (2) a distance-aware pairwise loss that encourages the predicted polygons to fit the object boundaries. Compared with the mask-based weakly-supervised methods, BoxSnake further reduces the performance gap between the predicted segmentation and the bounding box, and shows significant superiority on the Cityscapes dataset. The code has been available publicly.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 58 of its 89 references that are in the map. First posted on arXiv 21 Mar 2023.

Builds on

58 of 89 references.

References · 58

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2017Mask R-CNNcited by 7,259
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  9. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  10. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  11. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  12. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
38 more
  1. 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
  2. 2019Hybrid Task Cascade for Instance Segmentationcited by 479
  3. 2019Distance-IoU Loss: Faster and Better Learning for Bounding Box Regressioncited by 454
  4. 2019YOLACT: Real-time Instance Segmentationcited by 441
  5. 2019PointRend: Image Segmentation as Renderingcited by 439
  6. 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 428
  7. 2018Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentationcited by 321
  8. 2020Conditional Convolutions for Instance Segmentationcited by 314
  9. 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
  10. 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
  11. 2021K-Net: Towards Unified Image Segmentationcited by 211
  12. 2019PolarMask: Single Shot Instance Segmentation with Polar Representationcited by 188
  13. 2021Instances as Queriescited by 157
  14. 2022A Unified Sequence Interface for Vision Taskscited by 152
  15. 2020BoxInst: High-Performance Instance Segmentation with Box Annotationscited by 150
  16. 2018On Regularized Losses for Weakly-supervised CNN Segmentationcited by 121
  17. 2018Efficient Interactive Annotation of Segmentation Datasets with Polygon-RNN++cited by 119
  18. 2018Normalized Cut Loss for Weakly-supervised CNN Segmentationcited by 112
  19. 2020Deep Snake for Real-Time Instance Segmentationcited by 111
  20. 2019Fast Interactive Object Annotation with Curve-GCNcited by 95
  21. 2019PolyTransform: Deep Polygon Transformer for Instance Segmentationcited by 92
  22. 2017Annotating Object Instances with a Polygon-RNNcited by 88
  23. 2020Learning Dynamic Routing for Semantic Segmentationcited by 79
  24. 2020Boundary-preserving Mask R-CNNcited by 74
  25. 2020End-to-End Object Detection with Fully Convolutional Networkcited by 70
  26. 2021SOLQ: Segmenting Objects by Learning Queriescited by 68
  27. 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
  28. 2021DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervisioncited by 59
  29. 2021Affinity Attention Graph Neural Network for Weakly Supervised Semantic Segmentationcited by 47
  30. 2019ShapeMask: Learning to Segment Novel Objects by Refining Shape Priorscited by 42
  31. 2022Box-supervised Instance Segmentation with Level Set Evolutioncited by 41
  32. 2019TACNet: Transition-Aware Context Network for Spatio-Temporal Action Detectioncited by 36
  33. 2022ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformercited by 36
  34. 2022E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentationcited by 27
  35. 2019Learnable Tree Filter for Structure-preserving Feature Transformcited by 25
  36. 2022DBQ-SSD: Dynamic Ball Query for Efficient 3D Object Detectioncited by 25
  37. 2023Dynamic Grained Encoder for Vision Transformerscited by 24
  38. 2021Weakly-supervised Instance Segmentation via Class-agnostic Learning with Salient Imagescited by 20

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 6; 2024: 4; 2025: 0; 2026: 2.

12 papers.

  1. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  2. 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
  3. 2023Meta-Adapter: An Online Few-shot Learner for Vision-Language Modelcited by 31
  4. 2024GrootVL: Tree Topology is All You Need in State Space Modelcited by 13
  5. 2023UniHead: Unifying Multi-Perception for Detection Headscited by 9
  6. 2023Label-efficient Segmentation via Affinity Propagationcited by 7
  7. 2024Detecting Wildfires on UAVs with Real-time Segmentation Trained by Larger Teacher Modelscited by 5
  8. 2024Video Object Segmentation with Dynamic Query Modulationcited by 2
  9. 2023BoxCell: Leveraging SAM for Cell Segmentation with Box Supervisioncited by 1
  10. 2024Advancing SEM Based Nano-Scale Defect Analysis in Semiconductor Manufacturing for Advanced IC Nodescited by 0
  11. 2026SAPNet++: Evolving Point-Prompted Instance Segmentation with Semantic and Spatial Awarenesscited by 0
  12. 2026Noise-Robust Box-Supervised Infrared Small Target Detection via Physics-Inspired Soft Label Optimizationcited by 0