mlsanityData to 7 Oct 2026

Annotating Object Instances with a Polygon-RNN

arXiv 1704.05548 ↗First posted 18 Apr 2017cs.CVcited by 88

Not on the map. Why?

Abstract (arXiv)

We propose an approach for semi-automatic annotation of object instances. While most current methods treat object segmentation as a pixel-labeling problem, we here cast it as a polygon prediction task, mimicking how most current datasets have been annotated. In particular, our approach takes as input an image crop and sequentially produces vertices of the polygon outlining the object. This allows a human annotator to interfere at any time and correct a vertex if needed, producing as accurate segmentation as desired by the annotator. We show that our approach speeds up the annotation process by a factor of 4.7 across all classes in Cityscapes, while achieving 78.4% agreement in IoU with original ground-truth, matching the typical agreement between human annotators. For cars, our speed-up factor is 7.3 for an agreement of 82.2%. We further show generalization capabilities of our approach to unseen datasets.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 25; 2022: 14; 2023: 23; 2024: 15; 2025: 5; 2026: 6.

88 papers.

Sort:

By area:

  1. 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
  2. 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
  3. 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
  4. 2022A Unified Sequence Interface for Vision Taskscited by 152
  5. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  6. 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 144
  7. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
  8. 2021STEP: Segmenting and Tracking Every Pixelcited by 72
  9. 2023General Object Foundation Model for Images and Videos at Scalecited by 71
  10. 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 65
  11. 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
  12. 2021MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learningcited by 45
38 more
  1. 2021Auto4D: Learning to Label 4D Objects from Sequential Point Cloudscited by 42
  2. 2021PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Imagescited by 42
  3. 2021Boundary-Aware Segmentation Network for Mobile and Web Applicationscited by 41
  4. 2021All you need are a few pixels: semantic segmentation with PixelPickcited by 30
  5. 2024Interactive Medical Image Segmentation: A Benchmark Dataset and Baselinecited by 30
  6. 2024TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learningcited by 29
  7. 2023Once Detected, Never Lost: Surpassing Human Performance in Offline LiDAR based 3D Object Detectioncited by 28
  8. 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 26
  9. 2021A Spacecraft Dataset for Detection, Segmentation and Parts Recognitioncited by 22
  10. 2021iCurb: Imitation Learning-based Detection of Road Curbs using Aerial Images for Autonomous Drivingcited by 21
  11. 2022Towards General-Purpose Representation Learning of Polygonal Geometriescited by 21
  12. 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collectioncited by 19
  13. 2023Learning the What and How of Annotation in Video Object Segmentationcited by 19
  14. 2024Interactive 3D Medical Image Segmentation with SAM 2cited by 17
  15. 2023ScalableMap: Scalable Map Learning for Online Long-Range Vectorized HD Map Constructioncited by 16
  16. 2023Structure Embedded Nucleus Classification for Histopathology Imagescited by 14
  17. 2023Interactive Segmentation as Gaussian Process Classificationcited by 14
  18. 2023DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformercited by 14
  19. 2023Boundary-aware Supervoxel-level Iteratively Refined Interactive 3D Image Segmentation with Multi-agent Reinforcement Learningcited by 13
  20. 2021Probabilistic Attention for Interactive Segmentationcited by 12
  21. 2022SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentationcited by 12
  22. 2023BoxSnake: Polygonal Instance Segmentation with Box Supervisioncited by 12
  23. 2021CP-loss: Connectivity-preserving Loss for Road Curb Detection in Autonomous Driving with Aerial Imagescited by 9
  24. 2021Scaling up instance annotation via label propagationcited by 9
  25. 2022MAP-Gen: An Automated 3D-Box Annotation Flow with Multimodal Attention Point Generatorcited by 9
  26. 2023Temporally-Extended Prompts Optimization for SAM in Interactive Medical Image Segmentationcited by 9
  27. 2023PanopticNeRF-360: Panoramic 3D-to-2D Label Transfer in Urban Scenescited by 9
  28. 2021VideoClick: Video Object Segmentation with a Single Clickcited by 8
  29. 2021Robust Interactive Semantic Segmentation of Pathology Images with Minimal User Inputcited by 8
  30. 2022Beta R-CNN: Looking into Pedestrian Detection from Another Perspectivecited by 8
  31. 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 8
  32. 2021Binary segmentation of medical images using implicit spline representations and deep learningcited by 7
  33. 2021RaidaR: A Rich Annotated Image Dataset of Rainy Street Scenescited by 7
  34. 2022Semantic keypoint-based pose estimation from single RGB framescited by 7
  35. 2021Structured Outdoor Architecture Reconstruction by Exploration and Classificationcited by 6
  36. 2023Pix2Map: Cross-modal Retrieval for Inferring Street Maps from Imagescited by 6
  37. 2023HiT: Building Mapping with Hierarchical Transformerscited by 6
  38. 2024PolyR-CNN: R-CNN for end-to-end polygonal building outline extractioncited by 6

50 most cited of 88 All 88 (JSON)