mlsanityData to 7 Oct 2026

Deformation Robust Text Spotting with Geometric Prior

arXiv 2308.16404 ↗First posted 31 Aug 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The goal of text spotting is to perform text detection and recognition in an end-to-end manner. Although the diversity of luminosity and orientation in scene texts has been widely studied, the font diversity and shape variance of the same character are ignored in recent works, since most characters in natural images are rendered in standard fonts. To solve this problem, we present a Chinese Artistic Dataset, termed as ARText, which contains 33,000 artistic images with rich shape deformation and font diversity. Based on this database, we develop a deformation robust text spotting method (DR TextSpotter) to solve the recognition problem of complex deformation of characters in different fonts. Specifically, we propose a geometric prior module to highlight the important features based on the unsupervised landmark detection sub-network. A graph convolution network is further constructed to fuse the character features and landmark features, and then performs semantic reasoning to enhance the discrimination for different characters. The experiments are conducted on ARText and IC19-ReCTS datasets. Our results demonstrate the effectiveness of our proposed method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 47 references that are in the map. First posted on arXiv 31 Aug 2023.

Builds on

34 of 47 references.

References · 34

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  6. 2017Mask R-CNNcited by 7,259
  7. 2019Character Region Awareness for Text Detectioncited by 273
  8. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
  9. 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
  10. 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
  11. 2019ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboardcited by 127
  12. 2018Graph-Based Global Reasoning Networkscited by 120
22 more
  1. 2019Efficient and Accurate Arbitrary-Shaped Text Detection with Pixel Aggregation Networkcited by 114
  2. 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
  3. 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
  4. 2021Non-Salient Region Object Mining for Weakly Supervised Semantic Segmentationcited by 95
  5. 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
  6. 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
  7. 20223D face reconstruction with dense landmarkscited by 70
  8. 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
  9. 2017Unsupervised learning of object landmarks by factorized spatial embeddingscited by 64
  10. 2019Convolutional Character Networkscited by 61
  11. 2019Towards Unconstrained End-to-End Text Spottingcited by 57
  12. 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
  13. 2018An end-to-end TextSpotter with Explicit Alignment and Attentioncited by 50
  14. 2022Sparse Local Patch Transformer for Robust Face Alignment and Landmarks Inherent Relation Learningcited by 47
  15. 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
  16. 2020Character Region Attention For Text Spottingcited by 42
  17. 2022Towards Accurate Facial Landmark Detection via Cascaded Transformerscited by 31
  18. 2020AE TextSpotter: Learning Visual and Linguistic Representation for Ambiguous Text Spottingcited by 14
  19. 2022Recognition of Handwritten Chinese Text by Segmentation: A Segment-annotation-free Approachcited by 14
  20. 2015Facial Landmark Detection with Tweaked Convolutional Neural Networkscited by 13
  21. 2022TextDCT: Arbitrary-Shaped Text Detection via Discrete Cosine Transform Maskcited by 13
  22. 2022One-Shot Medical Landmark Localization by Edge-Guided Transform and Noisy Landmark Refinementcited by 8

Built on by

Not cited yet.