Revisiting Classification Perspective on Scene Text Recognition
Not on the map. Why?
Abstract (arXiv)
The prevalent perspectives of scene text recognition are from sequence to sequence (seq2seq) and segmentation. Nevertheless, the former is composed of many components which makes implementation and deployment complicated, while the latter requires character level annotations that is expensive. In this paper, we revisit classification perspective that models scene text recognition as an image classification problem. Classification perspective has a simple pipeline and only needs word level annotations. We revive classification perspective by devising a scene text recognition model named as CSTR, which performs as well as methods from other perspectives. The CSTR model consists of CPNet (classification perspective network) and SPPN (separated conv with global average pooling prediction network). CSTR is as simple as image classification model like ResNet citehe2016deep which makes it easy to implement and deploy. We demonstrate the effectiveness of the classification perspective on scene text recognition with extensive experiments. Futhermore, CSTR achieves nearly state-of-the-art performance on six public benchmarks including regular text, irregular text. The code will be available at https://github.com/Media-Smart/vedastr.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 36 of its 48 references that are in the map. First posted on arXiv 22 Feb 2021.
Builds on
36 of 48 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2017Non-local Neural Networkscited by 2,290
- 2015Spatial Transformer Networkscited by 1,423
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
24 more
- 2015Attention-Based Models for Speech Recognitioncited by 400
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
- 2017A Structured Self-attentive Sentence Embeddingcited by 318
- 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
- 2019What Is Wrong With Scene Text Recognition Model Comparisons? Dataset and Model Analysiscited by 191
- 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
- 2020Towards Accurate Scene Text Recognition with Semantic Reasoning Networkscited by 131
- 2018Show, Attend and Read: A Simple and Strong Baseline for Irregular Text Recognitioncited by 130
- 2016Robust Scene Text Recognition with Automatic Rectificationcited by 121
- 2020SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognitioncited by 119
- 2017Focusing Attention: Towards Accurate Text Recognition in Natural Imagescited by 110
- 2019Decoupled Attention Network for Text Recognitioncited by 102
- 2018ESIR: End-to-end Scene Text Recognition via Iterative Image Rectificationcited by 79
- 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
- 2019Rosetta: Large scale system for text detection and recognition in imagescited by 69
- 2020SCATTER: Selective Context Attentional Scene Text Recognizercited by 69
- 2019TextScanner: Reading Characters in Order for Robust Scene Text Recognitioncited by 68
- 2019MASTER: Multi-Aspect Non-local Network for Scene Text Recognitioncited by 65
- 2019On Recognizing Texts of Arbitrary Shapes with 2D Self-Attentioncited by 59
- 2018Scene Text Recognition from Two-Dimensional Perspectivecited by 57
- 2020GTC: Guided Training of CTC Towards Efficient and Accurate Scene Text Recognitioncited by 52
- 2019Symmetry-constrained Rectification Network for Scene Text Recognitioncited by 45
- 2019KISS: Keeping It Simple for Scene Text Recognitioncited by 4
- 2018Recurrent Calibration Network for Irregular Text Recognitioncited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 2.
5 papers.
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2024Decoder Pre-Training with only Text for Scene Text Recognitioncited by 3
- 2023An End-to-End Neural Network for Image-to-Audio Transformationcited by 2
- 2024Open-Vocabulary Scene Text Recognition via Pseudo-Image Labeling and Margin Losscited by 0
- 2024Decoder Pre-Training with only Text for Scene Text Recognition11 Aug 2024
- 2024Open-Vocabulary Scene Text Recognition via Pseudo-Image Labeling and Margin Loss12 Mar 2024
- 2023An End-to-End Neural Network for Image-to-Audio Transformation10 Mar 2023
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Models14 Jul 2022
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models21 Sep 2021