SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognition
Not on the map. Why?
Abstract (arXiv)
Scene text recognition is a hot research topic in computer vision. Recently, many recognition methods based on the encoder-decoder framework have been proposed, and they can handle scene texts of perspective distortion and curve shape. Nevertheless, they still face lots of challenges like image blur, uneven illumination, and incomplete characters. We argue that most encoder-decoder methods are based on local visual features without explicit global semantic information. In this work, we propose a semantics enhanced encoder-decoder framework to robustly recognize low-quality scene texts. The semantic information is used both in the encoder module for supervision and in the decoder module for initializing. In particular, the state-of-the art ASTER method is integrated into the proposed framework as an exemplar. Extensive experiments demonstrate that the proposed framework is more robust for low-quality text images, and achieves state-of-the-art results on several benchmark datasets.
Key facts. Cited by 119 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 23; 2023: 24; 2024: 18; 2025: 13; 2026: 5.
119 papers.
Sort:
By area:
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 52
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2021Split, embed and merge: An accurate table structure recognizercited by 42
- 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
38 more
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognitioncited by 40
- 2021Text Prior Guided Scene Text Image Super-resolutioncited by 37
- 2021Multi-View Correlation Distillation for Incremental Object Detectioncited by 36
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
- 2021Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Featurescited by 34
- 2022MaskOCR: Text Recognition with Masked Encoder-Decoder Pretrainingcited by 34
- 2025ViMo: A Generative Visual GUI World Model for App Agentscited by 33
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2021Primitive Representation Learning for Scene Text Recognitioncited by 28
- 2021Text Gestalt: Stroke-Aware Scene Text Image Super-Resolutioncited by 28
- 2022Self-supervised Character-to-Character Distillation for Text Recognitioncited by 27
- 2021TPSNet: Reverse Thinking of Thin Plate Splines for Arbitrary Shape Scene Text Representationcited by 26
- 2021Visual Semantics Allow for Textual Reasoning Better in Scene Text Recognitioncited by 25
- 2022Self-supervised Implicit Glyph Attention for Text Recognitioncited by 25
- 2021Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognitioncited by 24
- 2021Dense Semantic Contrast for Self-Supervised Visual Representation Learningcited by 24
- 2022Levenshtein OCRcited by 24
- 2023Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligningcited by 24
- 2021Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text Detectioncited by 23
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2023Context Perception Parallel Decoder for Scene Text Recognitioncited by 19
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2024Instruction-Guided Scene Text Recognitioncited by 17
- 2022Multimodal Semi-Supervised Learning for Text Recognitioncited by 16
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2023Symmetrical Linguistic Feature Distillation with CLIP for Scene Text Recognitioncited by 14
- 2021PERT: A Progressively Region-based Network for Scene Text Removalcited by 13
- 2021Towards the Unseen: Iterative Text Recognition by Distilling from Errorscited by 12
- 2022Towards Open-Set Text Recognition via Label-to-Prototype Learningcited by 12
- 2023Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learningcited by 12
- 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognitioncited by 12
- 2021TextAdaIN: Paying Attention to Shortcut Learning in Text Recognizerscited by 11
- 2022Out-of-Vocabulary Challenge Reportcited by 11
- 2024Out of Length Text Recognition with Sub-String Matchingcited by 11
50 most cited of 119 All 119 (JSON)
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts21 Sep 2026
- 2026Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition11 Aug 2026
- 2026Masked Next-Scale Prediction for Self-supervised Scene Text Recognition14 May 2026
- 2026Multi-Modal Character Localization and Extraction for Chinese Text Recognition14 Mar 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2025Towards Natural Language-Based Document Image Retrieval: New Dataset and Benchmark23 Dec 2025
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025Bridging Visual Affective Gap: Borrowing Textual Knowledge by Learning from Noisy Image-Text Pairs21 Nov 2025
- 2025OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition11 Nov 2025
- 2025TADoc: Robust Time-Aware Document Image Dewarping9 Aug 2025
- 2025Uni-DocDiff: A Unified Document Restoration Model Based on Diffusion6 Aug 2025
- 2025TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition2 Aug 2025
38 more
- 2025Class-Agnostic Region-of-Interest Matching in Document Images26 Jun 2025
- 2025DOTA: Deformable Optimized Transformer Architecture for End-to-End Text Recognition with Retrieval-Augmented Generation7 May 2025
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation30 Apr 2025
- 2025ViMo: A Generative Visual GUI World Model for App Agents15 Apr 2025
- 2025A Lightweight Multi-Module Fusion Approach for Korean Character Recognition8 Apr 2025
- 2025Linguistics-aware Masked Image Modeling for Self-supervised Scene Text Recognition24 Mar 2025
- 2024Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidance13 Dec 2024
- 2024DiffDesign: Controllable Diffusion with Meta Prior for Efficient Interior Design Generation25 Nov 2024
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognition24 Nov 2024
- 2024Relational Contrastive Learning and Masked Image Modeling for Scene Text Recognition18 Nov 2024
- 2024SAN: Structure-Aware Network for Complex and Long-tailed Chinese Text Recognition10 Nov 2024
- 2024Improving Handwritten Text Recognition via 3D Attention and Multi-Scale Training24 Oct 2024
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Control14 Oct 2024
- 2024One Model for Two Tasks: Cooperatively Recognizing and Recovering Low-Resolution Scene Text Images by Iterative Mutual Guidance22 Sep 2024
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2024Focus, Distinguish, and Prompt: Unleashing CLIP for Efficient and Flexible Scene Text Retrieval1 Aug 2024
- 2024Out of Length Text Recognition with Sub-String Matching17 Jul 2024
- 2024HAAP: Vision-context Hierarchical Attention Autoregressive with Adaptive Permutation for Scene Text Recognition15 May 2024
- 2024TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model15 Mar 2024
- 2024Open-Vocabulary Scene Text Recognition via Pseudo-Image Labeling and Margin Loss12 Mar 2024
- 2024Efficiently Leveraging Linguistic Priors for Scene Text Spotting27 Feb 2024
- 2024Class-Aware Mask-Guided Feature Refinement for Scene Text Recognition21 Feb 2024
- 2024Visual Text Meets Low-level Vision: A Comprehensive Survey on Visual Text Processing5 Feb 2024
- 2024Instruction-Guided Scene Text Recognition31 Jan 2024
- 2023Bidirectional Trained Tree-Structured Decoder for Handwritten Mathematical Expression Recognition31 Dec 2023
- 2023An Empirical Study of Scaling Law for OCR29 Dec 2023
- 2023IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition19 Dec 2023
- 2023Symmetrical Linguistic Feature Distillation with CLIP for Scene Text Recognition8 Oct 2023
- 2023Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligning3 Sep 2023
- 2023Orientation-Independent Chinese Text Recognition in Scene Images3 Sep 2023
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognition30 Aug 2023
- 2023Semantic Graph Representation Learning for Handwritten Mathematical Expression Recognition21 Aug 2023
- 2023Self-distillation Regularized Connectionist Temporal Classification Loss for Text Recognition: A Simple Yet Effective Approach17 Aug 2023
- 2023Towards Robust Real-Time Scene Text Detection: From Semantic to Instance Representation Learning14 Aug 2023
- 2023Relational Contrastive Learning for Scene Text Recognition1 Aug 2023
- 2023HiREN: Towards Higher Supervision Quality for Better Scene Text Image Super-Resolution31 Jul 2023
- 2023Multi-Granularity Prediction with Learnable Fusion for Scene Text Recognition25 Jul 2023
- 2023Context Perception Parallel Decoder for Scene Text Recognition23 Jul 2023
50 newest of 119 All 119 (JSON)
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognitioncited by 20
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognitioncited by 4
- 2024DiffDesign: Controllable Diffusion with Meta Prior for Efficient Interior Design Generationcited by 1
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2024DiffDesign: Controllable Diffusion with Meta Prior for Efficient Interior Design Generation25 Nov 2024
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition7 Mar 2023
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technologycited by 2
- 2024@Bench: Benchmarking Vision-Language Models for Human-centered Assistive Technology21 Sep 2024
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model23 May 2023
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognition18 Jan 2023
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network22 Aug 2021
- 2025ViMo: A Generative Visual GUI World Model for App Agentscited by 33
- 2025ViMo: A Generative Visual GUI World Model for App Agents15 Apr 2025
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2021Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Studycited by 52
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2021Split, embed and merge: An accurate table structure recognizercited by 42
- 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognitioncited by 40
12 most cited of 108 All 108 (JSON)
- 2026Embedding Rotation Invariance for Provable Multi-Oriented Scene Text Recognition11 Aug 2026
- 2026Masked Next-Scale Prediction for Self-supervised Scene Text Recognition14 May 2026
- 2026Multi-Modal Character Localization and Extraction for Chinese Text Recognition14 Mar 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2025Towards Natural Language-Based Document Image Retrieval: New Dataset and Benchmark23 Dec 2025
- 2025Bridging Visual Affective Gap: Borrowing Textual Knowledge by Learning from Noisy Image-Text Pairs21 Nov 2025
- 2025OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition11 Nov 2025
- 2025TADoc: Robust Time-Aware Document Image Dewarping9 Aug 2025
- 2025Uni-DocDiff: A Unified Document Restoration Model Based on Diffusion6 Aug 2025
- 2025TEACH: Text Encoding as Curriculum Hints for Scene Text Recognition2 Aug 2025
- 2025Class-Agnostic Region-of-Interest Matching in Document Images26 Jun 2025
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation30 Apr 2025
12 newest of 108 All 108 (JSON)