Progressive Evolution from Single-Point to Polygon for Scene Text
Not on the map. Why?
Abstract (arXiv)
The advancement of text shape representations towards compactness has enhanced text detection and spotting performance, but at a high annotation cost. Current models use single-point annotations to reduce costs, yet they lack sufficient localization information for downstream applications. To overcome this limitation, we introduce Point2Polygon, which can efficiently transform single-points into compact polygons. Our method uses a coarse-to-fine process, starting with creating and selecting anchor points based on recognition confidence, then vertically and horizontally refining the polygon using recognition information to optimize its shape. We demonstrate the accuracy of the generated polygons through extensive experiments: 1) By creating polygons from ground truth points, we achieved an accuracy of 82.0% on ICDAR 2015; 2) In training detectors with polygons generated by our method, we attained 86% of the accuracy relative to training with ground truth (GT); 3) Additionally, the proposed Point2Polygon can be seamlessly integrated to empower single-point spotters to generate polygons. This integration led to an impressive 82.5% accuracy for the generated polygons. It is worth mentioning that our method relies solely on synthetic recognition information, eliminating the need for any manual annotation beyond single points.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 42 references that are in the map. First posted on arXiv 21 Dec 2023.
Builds on
31 of 42 references.
References · 31
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2019Character Region Awareness for Text Detectioncited by 278
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2019Real-time Scene Text Detection with Differentiable Binarizationcited by 214
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2019Shape Robust Text Detection with Progressive Scale Expansion Networkcited by 147
- 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
- 2019Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Networkcited by 114
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
19 more
- 2016Detecting Text in Natural Image with Connectionist Text Proposal Networkcited by 85
- 2019Editing Text in the Wildcited by 82
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022Text Spotting Transformerscited by 70
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2022Towards Weakly-Supervised Text Spotting using a Multi-Task Transformercited by 41
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2017Deep Direct Regression for Multi-Oriented Scene Text Detectioncited by 37
- 2022Exploring Stroke-Level Modifications for Scene Text Editingcited by 37
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformercited by 29
- 2023Towards Unified Scene Text Spotting based on Sequence Generationcited by 27
- 2017WordSup: Exploiting Word Annotations for Character based Text Detectioncited by 14
- 2017WeText: Scene Text Detection under Weak Supervisioncited by 13
- 2021PERT: A Progressively Region-based Network for Scene Text Removalcited by 13
- 2023PBFormer: Capturing Complex Scene Text Shape with Polynomial Band Transformercited by 3
- 2020Polygon-free: Unconstrained Scene Text Detection with Box Annotationscited by 2
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025Edge Approximation Text Detectorcited by 3
- 2025Edge Approximation Text Detector5 Apr 2025