OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition
Not on the map. Why?
Abstract (arXiv)
Scene Text Recognition (STR) remains challenging due to real-world complexities, where decoupled visual-linguistic optimization in existing frameworks amplifies error propagation through cross-modal misalignment. Visual encoders exhibit attention bias toward background distractors, while decoders suffer from spatial misalignment when parsing geometrically deformed text-collectively degrading recognition accuracy for irregular patterns. Inspired by the hierarchical cognitive processes in human visual perception, we propose OTSNet, a novel three-stage network embodying a neurocognitive-inspired Observation-Thinking-Spelling pipeline for unified STR modeling. The architecture comprises three core components: (1) a Dual Attention Macaron Encoder (DAME) that refines visual features through differential attention maps to suppress irrelevant regions and enhance discriminative focus; (2) a Position-Aware Module (PAM) and Semantic Quantizer (SQ) that jointly integrate spatial context with glyph-level semantic abstraction via adaptive sampling; and (3) a Multi-Modal Collaborative Verifier (MMCV) that enforces self-correction through cross-modal fusion of visual, semantic, and character-level features. Extensive experiments demonstrate that OTSNet achieves state-of-the-art performance, attaining 83.5% average accuracy on the challenging Union14M-L benchmark and 79.1% on the heavily occluded OST dataset-establishing new records across 9 out of 14 evaluation scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 53 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
32 of 53 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2020Towards Accurate Scene Text Recognition with Semantic Reasoning Networkscited by 131
- 2014Reading Text in the Wild with Convolutional Neural Networkscited by 122
- 2020SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognitioncited by 119
- 2019Decoupled Attention Network for Text Recognitioncited by 102
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
20 more
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2020RobustScanner: Dynamically Enhancing Positional Clues for Robust Text Recognitioncited by 85
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
- 2020ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detectioncited by 69
- 2019On Recognizing Texts of Arbitrary Shapes with 2D Self-Attentioncited by 59
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
- 2016Multi-Oriented Text Detection with Fully Convolutional Networkscited by 36
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
- 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
- 2021Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Featurescited by 34
- 2019TextSR: Content-Aware Text Super-Resolution Guided by Recognitioncited by 26
- 2019DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution with Large Factorscited by 24
- 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
- 2018Edit Probability for Scene Text Recognitioncited by 19
- 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
- 2020Separating Content from Style Using Adversarial Learning for Recognizing Text in the Wildcited by 14
- 2024Class-Aware Mask-Guided Feature Refinement for Scene Text Recognitioncited by 10
- 2024Decoder Pre-Training with only Text for Scene Text Recognitioncited by 3
Built on by
Not cited yet.