mlsanityData to 7 Oct 2026

Arbitrary Shape Text Detection via Segmentation with Probability Maps

arXiv 2208.12419 ↗First posted 26 Aug 2022cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

Arbitrary shape text detection is a challenging task due to the significantly varied sizes and aspect ratios, arbitrary orientations or shapes, inaccurate annotations, etc. Due to the scalability of pixel-level prediction, segmentation-based methods can adapt to various shape texts and hence attracted considerable attention recently. However, accurate pixel-level annotations of texts are formidable, and the existing datasets for scene text detection only provide coarse-grained boundary annotations. Consequently, numerous misclassified text pixels or background pixels inside annotations always exist, degrading the performance of segmentation-based text detection methods. Generally speaking, whether a pixel belongs to text or not is highly related to the distance with the adjacent annotation boundary. With this observation, in this paper, we propose an innovative and robust segmentation-based detection method via probability maps for accurately detecting text instances. To be concrete, we adopt a Sigmoid Alpha Function (SAF) to transfer the distances between boundaries and their inside pixels to a probability map. However, one probability map can not cover complex probability distributions well because of the uncertainty of coarse-grained text boundary annotations. Therefore, we adopt a group of probability maps computed by a series of Sigmoid Alpha Functions to describe the possible probability distributions. In addition, we propose an iterative model to learn to predict and assimilate probability maps for providing enough information to reconstruct text instances. Finally, simple region growth algorithms are adopted to aggregate probability maps to complete text instances. Experimental results demonstrate that our method achieves state-of-the-art performance in terms of detection accuracy on several benchmarks.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 26 Aug 2022.

Builds on

45 of 65 references.

References · 45

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  6. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
  7. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  8. 2019Character Region Awareness for Text Detectioncited by 273
  9. 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
  10. 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
  11. 2019Real-time Scene Text Detection with Differentiable Binarizationcited by 212
  12. 2017Arbitrary-Oriented Scene Text Detection via Rotation Proposalscited by 176
33 more
  1. 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
  2. 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
  3. 2019Shape Robust Text Detection with Progressive Scale Expansion Networkcited by 147
  4. 2018TextBoxes++: A Single-Shot Oriented Scene Text Detectorcited by 119
  5. 2018TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapescited by 114
  6. 2019Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Networkcited by 114
  7. 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
  8. 2018Rotation-Sensitive Regression for Oriented Scene Text Detectioncited by 88
  9. 2016Detecting Text in Natural Image with Connectionist Text Proposal Networkcited by 85
  10. 2017Detecting Curve Text in the Wild: New Dataset and New Solutioncited by 82
  11. 2017Detecting Oriented Text in Natural Images by Linking Segmentscited by 80
  12. 2020Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detectioncited by 77
  13. 2020ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detectioncited by 69
  14. 2019Look More Than Once: An Accurate Detector for Text of Arbitrary Shapescited by 66
  15. 2019All You Need Is Boundary: Toward Arbitrary-Shaped Text Spottingcited by 66
  16. 2018PixelLink: Detecting Scene Text via Instance Segmentationcited by 60
  17. 2020Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spottingcited by 51
  18. 2018TextField: Learning A Deep Direction Field for Irregular Scene Text Detectioncited by 50
  19. 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
  20. 2019Arbitrary Shape Scene Text Detection with Adaptive Text Region Representationcited by 45
  21. 2018Multi-Oriented Scene Text Detection via Corner Localization and Region Segmentationcited by 42
  22. 2017Deep Direct Regression for Multi-Oriented Scene Text Detectioncited by 37
  23. 2019MSR: Multi-Scale Shape Regression for Scene Text Detectioncited by 35
  24. 2018Accurate Scene Text Detection through Border Semantics Awareness and Bootstrappingcited by 20
  25. 2018Learning Markov Clustering Networks for Scene Text Detectioncited by 17
  26. 2022Kernel Proposal Network for Arbitrary Shape Text Detectioncited by 17
  27. 2018TextMountain: Accurate Scene Text Detection via Instance Segmentationcited by 16
  28. 2019Towards Robust Curve Text Detection with Conditional Spatial Expansioncited by 16
  29. 2018IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detectioncited by 12
  30. 2019Pyramid Mask Text Detectorcited by 9
  31. 2017Fused Text Segmentation Networks for Multi-oriented Scene Text Detectioncited by 7
  32. 2022Graph Fusion Network for Multi-Oriented Object Detectioncited by 7
  33. 2018Pixel-Anchor: A Fast Oriented Scene Text Detector with Combined Networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 5; 2025: 4; 2026: 3.

15 papers.

Sort:

By area: