Scene Text Detection and Recognition: The Deep Learning Era
Not on the map. Why?
Abstract (arXiv)
With the rise and development of deep learning, computer vision has been tremendously transformed and reshaped. As an important research area in computer vision, scene text detection and recognition has been inescapably influenced by this wave of revolution, consequentially entering the era of deep learning. In recent years, the community has witnessed substantial advancements in mindset, approach and performance. This survey is aimed at summarizing and analyzing the major changes and significant progresses of scene text detection and recognition in the deep learning era. Through this article, we devote to: (1) introduce new insights and ideas; (2) highlight recent techniques and benchmarks; (3) look ahead into future trends. Specifically, we will emphasize the dramatic differences brought by deep learning and the grand challenges still remained. We expect that this review paper would serve as a reference book for researchers in this field. Related resources are also collected and compiled in our Github repository: https://github.com/Jyouhou/SceneTextPapers.
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 22; 2023: 35; 2024: 10; 2025: 16; 2026: 9.
114 papers.
Sort:
By area:
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
38 more
- 2023GeoLayoutLM: Geometric Pre-training for Visual Information Extractioncited by 40
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
- 2021MOST: A Multi-Oriented Scene Text Detector with Localization Refinementcited by 33
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2021A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformercited by 26
- 2021Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognitioncited by 24
- 2022Levenshtein OCRcited by 24
- 2023ICDAR 2023 Competition on Hierarchical Text Detection and Recognitioncited by 23
- 2024Visual Text Generation in the Wildcited by 22
- 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 22
- 2023Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characterscited by 21
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023Modeling Entities as Semantic Points for Visual Information Extraction in the Wildcited by 20
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2021A Multiplexed Network for End-to-End, Multilingual OCRcited by 18
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2025HunyuanOCR Technical Reportcited by 18
- 2021Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillationcited by 17
- 2022Text-DIAE: A Self-Supervised Degradation Invariant Autoencoders for Text Recognition and Document Enhancementcited by 16
- 2022Multimodal Semi-Supervised Learning for Text Recognitioncited by 16
- 2023Improving Scene Text Image Super-resolution via Dual Prior Modulation Networkcited by 15
- 2022Seq-UPS: Sequential Uncertainty-aware Pseudo-label Selection for Semi-Supervised Text Recognitioncited by 14
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2023Scalable Mask Annotation for Video Text Spottingcited by 13
- 2023LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognitioncited by 13
- 2023Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learningcited by 12
- 2024DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Trainingcited by 11
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolutioncited by 10
- 2024Class-Aware Mask-Guided Feature Refinement for Scene Text Recognitioncited by 10
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understandingcited by 10
- 2022Pure Transformer with Integrated Experts for Scene Text Recognitioncited by 9
- 2023TPS++: Attention-Enhanced Thin-Plate Spline for Scene Text Recognitioncited by 9
- 2026Towards Long-horizon Agentic Multimodal Searchcited by 9
- 2023Self-distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approachcited by 8
50 most cited of 114 All 114 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting30 Jul 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Text region detection in historical astronomical diagrams14 Jun 2026
- 2026TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillance5 Jun 2026
- 2026Towards Long-horizon Agentic Multimodal Search14 Apr 2026
- 2026JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understanding30 Mar 2026
- 2025Text images processing system using artificial intelligence models12 Dec 2025
- 2025HunyuanOCR Technical Report24 Nov 2025
- 2025ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents17 Oct 2025
38 more
- 2025Automated document processing system for government agencies using DBNET++ and BART models15 Oct 2025
- 2025Automatic Intermodal Loading Unit Identification using Computer Vision: A Scoping Review22 Sep 2025
- 2025Improving OCR using internal document redundancy20 Aug 2025
- 2025ESTR-CoT: Towards Explainable and Accurate Event Stream based Scene Text Recognition with Chain-of-Thought Reasoning2 Jul 2025
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understanding28 May 2025
- 2025GoMatching++: Parameter- and Data-Efficient Arbitrary-Shaped Video Text Spotting and Benchmarking28 May 2025
- 2025InfoDet: A Dataset for Infographic Element Detection23 May 2025
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation30 Apr 2025
- 2025S2Teacher: Step-by-step Teacher for Sparsely Annotated Oriented Object Detection15 Apr 2025
- 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generation30 Mar 2025
- 2025Accurate Scene Text Recognition with Efficient Model Scaling and Cloze Self-Distillation20 Mar 2025
- 2025A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition19 Mar 2025
- 2025Billet Number Recognition Based on Test-Time Adaptation13 Feb 2025
- 2024The MERIT Dataset: Modelling and Efficiently Rendering Interpretable Transcripts31 Aug 2024
- 2024Platypus: A Generalized Specialist Model for Reading Text in Various Forms27 Aug 2024
- 2024DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Training1 Aug 2024
- 2024Self-Supervised Learning for Text Recognition: A Critical Survey29 Jul 2024
- 2024Visual Text Generation in the Wild19 Jul 2024
- 2024Mixed Text Recognition with Efficient Parameter Fine-Tuning and Transformer19 Apr 2024
- 2024Class-Aware Mask-Guided Feature Refinement for Scene Text Recognition21 Feb 2024
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Models26 Jan 2024
- 2024EK-Net:Real-time Scene Text Detection with Expand Kernel Distance22 Jan 2024
- 2024Dynamic Relation Transformer for Contextual Text Block Detection17 Jan 2024
- 2023Research on Multilingual Natural Scene Text Detection Algorithm18 Dec 2023
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models28 Nov 2023
- 2023Towards Detecting, Recognizing, and Parsing the Address Information from Bangla Signboard: A Deep Learning-based Approach22 Nov 2023
- 2023Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters19 Nov 2023
- 2023Hierarchical Text Spotter for Joint Text Spotting and Layout Analysis25 Oct 2023
- 2023DocXChain: A Powerful Open-Source Toolchain for Document Parsing and Beyond19 Oct 2023
- 2023Selective Scene Text Removal1 Sep 2023
- 2023Is it an i or an l: Test-time Adaptation of Text Line Recognition Models29 Aug 2023
- 2023PBFormer: Capturing Complex Scene Text Shape with Polynomial Band Transformer29 Aug 2023
- 2023Vision Grid Transformer for Document Layout Analysis29 Aug 2023
- 2023LISTER: Neighbor Decoding for Length-Insensitive Scene Text Recognition24 Aug 2023
- 2023Self-distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach17 Aug 2023
- 2023Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learning14 Aug 2023
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution13 Aug 2023
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Frames8 Aug 2023
50 newest of 114 All 114 (JSON)
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2025HunyuanOCR Technical Reportcited by 18
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Bettercited by 14
- 2026JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understandingcited by 0
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spottingcited by 0
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026JaWildText: A Benchmark for Vision-Language Models on Japanese Scene Text Understanding30 Mar 2026
- 2025HunyuanOCR Technical Report24 Nov 2025
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model23 May 2023
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectors29 Apr 2022
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolutioncited by 10
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Modelscited by 8
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Modelscited by 0
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Models26 Jan 2024
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models28 Nov 2023
- 2023TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution13 Aug 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition7 Mar 2023
- 2026Towards Long-horizon Agentic Multimodal Searchcited by 9
- 2026Towards Long-horizon Agentic Multimodal Search14 Apr 2026
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2023Vision Grid Transformer for Document Layout Analysiscited by 45
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023GeoLayoutLM: Geometric Pre-training for Visual Information Extractioncited by 40
12 most cited of 101 All 101 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting30 Jul 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Text region detection in historical astronomical diagrams14 Jun 2026
- 2026TraRA: Trajectory-level Recognition Aggregation for Video Text Spotting in Urban Surveillance5 Jun 2026
- 2025Text images processing system using artificial intelligence models12 Dec 2025
- 2025ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents17 Oct 2025
- 2025Automated document processing system for government agencies using DBNET++ and BART models15 Oct 2025
- 2025Automatic Intermodal Loading Unit Identification using Computer Vision: A Scoping Review22 Sep 2025
- 2025Improving OCR using internal document redundancy20 Aug 2025
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understanding28 May 2025
- 2025GoMatching++: Parameter- and Data-Efficient Arbitrary-Shaped Video Text Spotting and Benchmarking28 May 2025
12 newest of 101 All 101 (JSON)