Towards Accurate Scene Text Recognition with Semantic Reasoning Networks
Not on the map. Why?
Abstract (arXiv)
Scene text image contains two levels of contents: visual texture and semantic information. Although the previous scene text recognition methods have made great progress over the past few years, the research on mining semantic information to assist text recognition attracts less attention, only RNN-like structures are explored to implicitly model semantic information. However, we observe that RNN based methods have some obvious shortcomings, such as time-dependent decoding manner and one-way serial transmission of semantic context, which greatly limit the help of semantic information and the computation efficiency. To mitigate these limitations, we propose a novel end-to-end trainable framework named semantic reasoning network (SRN) for accurate scene text recognition, where a global semantic reasoning module (GSRM) is introduced to capture global semantic context through multi-way parallel transmission. The state-of-the-art results on 7 public benchmarks, including regular text, irregular text and non-Latin long text, verify the effectiveness and robustness of the proposed method. In addition, the speed of SRN has significant advantages over the RNN based methods, demonstrating its value in practical use.
Key facts. Cited by 131 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 30; 2022: 31; 2023: 34; 2024: 23; 2025: 8; 2026: 5.
131 papers.
Sort:
By area:
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 149
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
38 more
- 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 53
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognitioncited by 40
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
- 2021Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Featurescited by 34
- 2022MaskOCR: Text Recognition with Masked Encoder-Decoder Pretrainingcited by 34
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2021Primitive Representation Learning for Scene Text Recognitioncited by 28
- 2021MetaHTR: Towards Writer-Adaptive Handwritten Text Recognitioncited by 27
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2022Self-supervised Character-to-Character Distillation for Text Recognitioncited by 27
- 2024FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understandingcited by 27
- 2021Visual Semantics Allow for Textual Reasoning Better in Scene Text Recognitioncited by 25
- 2022Self-supervised Implicit Glyph Attention for Text Recognitioncited by 25
- 2021Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognitioncited by 24
- 2022Levenshtein OCRcited by 24
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 24
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Imagescited by 20
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2021Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillationcited by 17
- 2024Instruction-Guided Scene Text Recognitioncited by 17
- 2022Multimodal Semi-Supervised Learning for Text Recognitioncited by 16
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2022Seq-UPS: Sequential Uncertainty-aware Pseudo-label Selection for Semi-Supervised Text Recognitioncited by 14
- 2024KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embeddingcited by 14
- 2023LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognitioncited by 13
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameterscited by 13
50 most cited of 131 All 131 (JSON)
- 2026Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition11 Aug 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026Masked Next-Scale Prediction for Self-supervised Scene Text Recognition14 May 2026
- 2026Efficient Domain Adaptation for Text Line Recognition via Decoupled Language Models30 Mar 2026
- 2026Multi-Modal Character Localization and Extraction for Chinese Text Recognition14 Mar 2026
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters24 Dec 2025
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition11 Nov 2025
- 2025TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition2 Aug 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2025DOTA: Deformable Optimized Transformer Architecture for End-to-End Text Recognition with Retrieval-Augmented Generation7 May 2025
- 2025Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition24 Mar 2025
38 more
- 2025Advancing Autonomous Vehicle Intelligence: Deep Learning and Multimodal LLM for Traffic Sign Recognition and Robust Lane Detection8 Mar 2025
- 2024Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models11 Dec 2024
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition24 Nov 2024
- 2024Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing23 Nov 2024
- 2024Relational Contrastive Learning and Masked Image Modeling for Scene Text Recognition18 Nov 2024
- 2024SAN: Structure-Aware Network for Complex and Long-tailed Chinese Text Recognition10 Nov 2024
- 2024One Model for Two Tasks: Cooperatively Recognizing and Recovering Low-Resolution Scene Text Images by Iterative Mutual Guidance22 Sep 2024
- 2024VL-Reader: Vision and Language Reconstructor is an Effective Scene Text Recognizer18 Sep 2024
- 2024KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embedding2 Sep 2024
- 2024Platypus: A Generalized Specialist Model for Reading Text in Various Forms27 Aug 2024
- 2024Decoder Pre-Training with only Text for Scene Text Recognition11 Aug 2024
- 2024Out of Length Text Recognition with Sub-String Matching17 Jul 2024
- 2024Focus on the Whole Character: Discriminative Character Modeling for Scene Text Recognition8 Jul 2024
- 2024FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understanding6 Jul 2024
- 2024HAAP: Vision-context Hierarchical Attention Autoregressive with Adaptive Permutation for Scene Text Recognition15 May 2024
- 2024Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognition9 May 2024
- 2024Mixed Text Recognition with Efficient Parameter Fine-Tuning and Transformer19 Apr 2024
- 2024Ensemble Learning for Vietnamese Scene Text Spotting in Urban Environments1 Apr 2024
- 2024Efficient scene text image super-resolution with semantic guidance20 Mar 2024
- 2024TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model15 Mar 2024
- 2024Instruction-Guided Scene Text Recognition31 Jan 2024
- 2024SVIPTR: Fast and Efficient Scene Text Recognition with Vision Permutable Extractor18 Jan 2024
- 2024CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition18 Jan 2024
- 2024SwinTextSpotter v2: Towards Better Synergy for Scene Text Spotting15 Jan 2024
- 2023Bidirectional Trained Tree-Structured Decoder for Handwritten Mathematical Expression Recognition31 Dec 2023
- 2023An Empirical Study of Scaling Law for OCR29 Dec 2023
- 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition19 Dec 2023
- 2023PEAN: A Diffusion-Based Prior-Enhanced Attention Network for Scene Text Image Super-Resolution29 Nov 2023
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizer22 Nov 2023
- 2023Scene Text Recognition Models Explainability Using Local Features14 Oct 2023
- 2023Orientation-Independent Chinese Text Recognition in Scene Images3 Sep 2023
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognition30 Aug 2023
- 2023LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition24 Aug 2023
- 2023Semantic Graph Representation Learning for Handwritten Mathematical Expression Recognition21 Aug 2023
- 2023Self-distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach17 Aug 2023
- 2023One-stage Low-resolution Text Recognition with High-resolution Knowledge Transfer5 Aug 2023
- 2023Relational Contrastive Learning for Scene Text Recognition1 Aug 2023
- 2023HiREN: Towards Higher Supervision Quality for Better Scene Text Image Super-Resolution31 Jul 2023
50 newest of 131 All 131 (JSON)
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognitioncited by 7
- 2025Text-Aware Image Restoration with Diffusion Modelscited by 6
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognitioncited by 4
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognition29 Jun 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023TextDiffuser: Diffusion Models as Text Painters18 May 2023
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition7 Mar 2023
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2024FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understandingcited by 27
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2024FlowLearn: Evaluating Large Vision-Language Models on Flowchart Understanding6 Jul 2024
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model23 May 2023
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognition18 Jan 2023
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting8 Mar 2022
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network22 Aug 2021
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 537
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 149
- 2021StrucTexT: Structured Text Understanding with Multi-Modal Transformerscited by 90
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 88
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 53
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
12 most cited of 116 All 116 (JSON)
- 2026Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition11 Aug 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026Masked Next-Scale Prediction for Self-supervised Scene Text Recognition14 May 2026
- 2026Efficient Domain Adaptation for Text Line Recognition via Decoupled Language Models30 Mar 2026
- 2026Multi-Modal Character Localization and Extraction for Chinese Text Recognition14 Mar 2026
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters24 Dec 2025
- 2025OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition11 Nov 2025
- 2025TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition2 Aug 2025
- 2025Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition24 Mar 2025
- 2024Disentanglement and Compositionality of Letter Identity and Letter Position in Variational Auto-Encoder Vision Models11 Dec 2024
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition24 Nov 2024
- 2024Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing23 Nov 2024
12 newest of 116 All 116 (JSON)