mlsanityData to 7 Oct 2026

OTSNet: A Neurocognitive-Inspired Observation-Thinking-Spelling Pipeline for Scene Text Recognition

arXiv 2511.08133 ↗First posted 11 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Scene Text Recognition (STR) remains challenging due to real-world complexities, where decoupled visual-linguistic optimization in existing frameworks amplifies error propagation through cross-modal misalignment. Visual encoders exhibit attention bias toward background distractors, while decoders suffer from spatial misalignment when parsing geometrically deformed text-collectively degrading recognition accuracy for irregular patterns. Inspired by the hierarchical cognitive processes in human visual perception, we propose OTSNet, a novel three-stage network embodying a neurocognitive-inspired Observation-Thinking-Spelling pipeline for unified STR modeling. The architecture comprises three core components: (1) a Dual Attention Macaron Encoder (DAME) that refines visual features through differential attention maps to suppress irrelevant regions and enhance discriminative focus; (2) a Position-Aware Module (PAM) and Semantic Quantizer (SQ) that jointly integrate spatial context with glyph-level semantic abstraction via adaptive sampling; and (3) a Multi-Modal Collaborative Verifier (MMCV) that enforces self-correction through cross-modal fusion of visual, semantic, and character-level features. Extensive experiments demonstrate that OTSNet achieves state-of-the-art performance, attaining 83.5% average accuracy on the challenging Union14M-L benchmark and 79.1% on the heavily occluded OST dataset-establishing new records across 9 out of 14 evaluation scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 53 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

32 of 53 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  4. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  5. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
  6. 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
  7. 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
  8. 2020Towards Accurate Scene Text Recognition with Semantic Reasoning Networkscited by 131
  9. 2014Reading Text in the Wild with Convolutional Neural Networkscited by 122
  10. 2020SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognitioncited by 119
  11. 2019Decoupled Attention Network for Text Recognitioncited by 102
  12. 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
20 more
  1. 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
  2. 2020RobustScanner: Dynamically Enhancing Positional Clues for Robust Text Recognitioncited by 85
  3. 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
  4. 2018NRTR: A No-Recurrence Sequence-to-Sequence Model For Scene Text Recognitioncited by 73
  5. 2020ContourNet: Taking a Further Step toward Accurate Arbitrary-shaped Scene Text Detectioncited by 69
  6. 2019On Recognizing Texts of Arbitrary Shapes with 2D Self-Attentioncited by 59
  7. 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
  8. 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
  9. 2016Multi-Oriented Text Detection with Fully Convolutional Networkscited by 36
  10. 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
  11. 2022Multi-Granularity Prediction for Scene Text Recognitioncited by 36
  12. 2021Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Featurescited by 34
  13. 2019TextSR: Content-Aware Text Super-Resolution Guided by Recognitioncited by 26
  14. 2019DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution with Large Factorscited by 24
  15. 2024SVTRv2: CTC Beats Encoder-Decoder Models in Scene Text Recognitioncited by 23
  16. 2018Edit Probability for Scene Text Recognitioncited by 19
  17. 2023Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognitioncited by 18
  18. 2020Separating Content from Style Using Adversarial Learning for Recognizing Text in the Wildcited by 14
  19. 2024Class-Aware Mask-Guided Feature Refinement for Scene Text Recognitioncited by 10
  20. 2024Decoder Pre-Training with only Text for Scene Text Recognitioncited by 3

Built on by

Not cited yet.