Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting
Not on the map. Why?
Abstract (arXiv)
End-to-end scene text spotting, which unifies text detection and recognition within a single framework, has witnessed remarkable progress driven by deep learning advances. However, most existing approaches still suffer from incomplete mask proposals caused by multi-scale variation, arbitrary text shapes, and complex background interference, thereby degrading recognition accuracy. In this paper, we propose a novel Soft Attention Mask Embedding module (SAME) that leverages the global receptive field of Transformer encoders to encode high-level features and compute soft attention weights, which are then hierarchically embedded with predicted masks to generate refined text-boundary-aware masks that effectively suppress background noise. Building upon this module, we present SAME-Net, a robust end-to-end text spotting framework that requires neither character-level annotations nor auxiliary text rectification modules. Since the soft attention mechanism is fully differentiable, recognition loss gradients can be back-propagated through the SAME module to the detection branch, enabling joint optimization of detection and recognition objectives. Extensive experiments on challenging benchmarks demonstrate the effectiveness of our approach: SAME-Net achieves 84.02% end-to-end H-mean on the arbitrarily-shaped Total-Text dataset, surpassing the previous state-of-the-art GLASS by 1.02% in full-lexicon accuracy without additional training data, and obtains competitive 83.4% strong-lexicon results on the multi-oriented ICDAR 2015 dataset.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 62 of its 75 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
62 of 75 references.
References · 62
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
- 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
38 more
- 2019Character Region Awareness for Text Detectioncited by 273
- 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
- 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
- 2018TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapescited by 114
- 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
- 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022Text Spotting Transformerscited by 70
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
- 2019All You Need Is Boundary: Toward Arbitrary-Shaped Text Spottingcited by 66
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2019Towards Unconstrained End-to-End Text Spottingcited by 57
- 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
- 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2021ISTR: End-to-End Instance Segmentation with Transformerscited by 52
- 2020MANGO: A Mask Attention Guided One-Stage Scene Text Spottercited by 51
- 2018An end-to-end TextSpotter with Explicit Alignment and Attentioncited by 50
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2024ParGo: Bridging Vision-Language with Partial and Global Viewscited by 40
- 2025Vision as LoRAcited by 37
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
50 most cited of 62 All 62 (JSON)
Built on by
Not cited yet.