Arbitrary Shape Text Detection via Segmentation with Probability Maps
Not on the map. Why?
Abstract (arXiv)
Arbitrary shape text detection is a challenging task due to the significantly varied sizes and aspect ratios, arbitrary orientations or shapes, inaccurate annotations, etc. Due to the scalability of pixel-level prediction, segmentation-based methods can adapt to various shape texts and hence attracted considerable attention recently. However, accurate pixel-level annotations of texts are formidable, and the existing datasets for scene text detection only provide coarse-grained boundary annotations. Consequently, numerous misclassified text pixels or background pixels inside annotations always exist, degrading the performance of segmentation-based text detection methods. Generally speaking, whether a pixel belongs to text or not is highly related to the distance with the adjacent annotation boundary. With this observation, in this paper, we propose an innovative and robust segmentation-based detection method via probability maps for accurately detecting text instances. To be concrete, we adopt a Sigmoid Alpha Function (SAF) to transfer the distances between boundaries and their inside pixels to a probability map. However, one probability map can not cover complex probability distributions well because of the uncertainty of coarse-grained text boundary annotations. Therefore, we adopt a group of probability maps computed by a series of Sigmoid Alpha Functions to describe the possible probability distributions. In addition, we propose an iterative model to learn to predict and assimilate probability maps for providing enough information to reconstruct text instances. Finally, simple region growth algorithms are adopted to aggregate probability maps to complete text instances. Experimental results demonstrate that our method achieves state-of-the-art performance in terms of detection accuracy on several benchmarks.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 45 of its 65 references that are in the map. First posted on arXiv 26 Aug 2022.
Builds on
45 of 65 references.
References · 45
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2019Character Region Awareness for Text Detectioncited by 273
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2019CANet: Class-Agnostic Segmentation Networks with Iterative Refinement and Attentive Few-Shot Learningcited by 217
- 2019Real-time Scene Text Detection with Differentiable Binarizationcited by 212
- 2017Arbitrary-Oriented Scene Text Detection via Rotation Proposalscited by 176
33 more
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
- 2019Shape Robust Text Detection with Progressive Scale Expansion Networkcited by 147
- 2018TextBoxes++: A Single-Shot Oriented Scene Text Detectorcited by 119
- 2018TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapescited by 114
- 2019Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Networkcited by 114
- 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
- 2018Rotation-Sensitive Regression for Oriented Scene Text Detectioncited by 88
- 2016Detecting Text in Natural Image with Connectionist Text Proposal Networkcited by 85
- 2017Detecting Curve Text in the Wild: New Dataset and New Solutioncited by 82
- 2017Detecting Oriented Text in Natural Images by Linking Segmentscited by 80
- 2020Deep Relational Reasoning Graph Network for Arbitrary Shape Text Detectioncited by 77
- 2020ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detectioncited by 69
- 2019Look More Than Once: An Accurate Detector for Text of Arbitrary Shapescited by 66
- 2019All You Need Is Boundary: Toward Arbitrary-Shaped Text Spottingcited by 66
- 2018PixelLink: Detecting Scene Text via Instance Segmentationcited by 60
- 2020Text Perceptron: Towards End-to-End Arbitrary-Shaped Text Spottingcited by 51
- 2018TextField: Learning A Deep Direction Field for Irregular Scene Text Detectioncited by 50
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
- 2019Arbitrary Shape Scene Text Detection with Adaptive Text Region Representationcited by 45
- 2018Multi-Oriented Scene Text Detection via Corner Localization and Region Segmentationcited by 42
- 2017Deep Direct Regression for Multi-Oriented Scene Text Detectioncited by 37
- 2019MSR: Multi-Scale Shape Regression for Scene Text Detectioncited by 35
- 2018Accurate Scene Text Detection through Border Semantics Awareness and Bootstrappingcited by 20
- 2018Learning Markov Clustering Networks for Scene Text Detectioncited by 17
- 2022Kernel Proposal Network for Arbitrary Shape Text Detectioncited by 17
- 2018TextMountain: Accurate Scene Text Detection via Instance Segmentationcited by 16
- 2019Towards Robust Curve Text Detection with Conditional Spatial Expansioncited by 16
- 2018IncepText: A New Inception-Text Module with Deformable PSROI Pooling for Multi-Oriented Scene Text Detectioncited by 12
- 2019Pyramid Mask Text Detectorcited by 9
- 2017Fused Text Segmentation Networks for Multi-oriented Scene Text Detectioncited by 7
- 2022Graph Fusion Network for Multi-Oriented Object Detectioncited by 7
- 2018Pixel-Anchor: A Fast Oriented Scene Text Detector with Combined Networkscited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 5; 2025: 4; 2026: 3.
15 papers.
Sort:
By area:
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Samplingcited by 9
- 2023LRANet: Towards Accurate and Efficient Scene Text Detection with Low-Rank Approximation Networkcited by 8
- 2025LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spottingcited by 4
- 2024Real-Time Text Detection with Similar Mask in Traffic, Industrial, and Natural Scenescited by 3
- 2025Edge Approximation Text Detectorcited by 3
- 2022Scene Text Recognition with Single-Point Decoding Networkcited by 1
- 2024Artistic-style text detector and a new Movie-Poster datasetcited by 1
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptionscited by 1
- 2022Aggregated Text Transformer for Scene Text Detectioncited by 0
- 2024BPDO:Boundary Points Dynamic Optimization for Arbitrary Shape Scene Text Detectioncited by 0
- 2024Video-Language Alignment via Spatio-Temporal Graph Transformercited by 0
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptions27 Jun 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2025LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spotting8 Nov 2025
- 2025Unsupervised Real-World Super-Resolution via Rectified Flow Degradation Modelling10 Aug 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding24 Mar 2025
- 2024Real-Time Text Detection with Similar Mask in Traffic, Industrial, and Natural Scenes5 Nov 2024
- 2024Video-Language Alignment via Spatio-Temporal Graph Transformer16 Jul 2024
- 2024Artistic-style text detector and a new Movie-Poster dataset24 Jun 2024
- 2024BPDO:Boundary Points Dynamic Optimization for Arbitrary Shape Scene Text Detection18 Jan 2024
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Sampling8 Jan 2024
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understandingcited by 30
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Samplingcited by 9
- 2023LRANet: Towards Accurate and Efficient Scene Text Detection with Low-Rank Approximation Networkcited by 8
- 2025LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spottingcited by 4
- 2024Real-Time Text Detection with Similar Mask in Traffic, Industrial, and Natural Scenescited by 3
- 2025Edge Approximation Text Detectorcited by 3
- 2022Scene Text Recognition with Single-Point Decoding Networkcited by 1
- 2024Artistic-style text detector and a new Movie-Poster datasetcited by 1
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptionscited by 1
- 2022Aggregated Text Transformer for Scene Text Detectioncited by 0
- 2024BPDO:Boundary Points Dynamic Optimization for Arbitrary Shape Scene Text Detectioncited by 0
- 2024Video-Language Alignment via Spatio-Temporal Graph Transformercited by 0
12 most cited of 14 All 14 (JSON)
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptions27 Jun 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2025LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spotting8 Nov 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding24 Mar 2025
- 2024Real-Time Text Detection with Similar Mask in Traffic, Industrial, and Natural Scenes5 Nov 2024
- 2024Video-Language Alignment via Spatio-Temporal Graph Transformer16 Jul 2024
- 2024Artistic-style text detector and a new Movie-Poster dataset24 Jun 2024
- 2024BPDO:Boundary Points Dynamic Optimization for Arbitrary Shape Scene Text Detection18 Jan 2024
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Sampling8 Jan 2024
- 2023LRANet: Towards Accurate and Efficient Scene Text Detection with Low-Rank Approximation Network27 Jun 2023
12 newest of 14 All 14 (JSON)