mlsanityData to 7 Oct 2026

Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting

arXiv 2605.18173 ↗First posted 18 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

End-to-end scene text spotting, which unifies text detection and recognition within a single framework, has witnessed remarkable progress driven by deep learning advances. However, most existing approaches still suffer from incomplete mask proposals caused by multi-scale variation, arbitrary text shapes, and complex background interference, thereby degrading recognition accuracy. In this paper, we propose a novel Soft Attention Mask Embedding module (SAME) that leverages the global receptive field of Transformer encoders to encode high-level features and compute soft attention weights, which are then hierarchically embedded with predicted masks to generate refined text-boundary-aware masks that effectively suppress background noise. Building upon this module, we present SAME-Net, a robust end-to-end text spotting framework that requires neither character-level annotations nor auxiliary text rectification modules. Since the soft attention mechanism is fully differentiable, recognition loss gradients can be back-propagated through the SAME module to the detection branch, enabling joint optimization of detection and recognition objectives. Extensive experiments on challenging benchmarks demonstrate the effectiveness of our approach: SAME-Net achieves 84.02% end-to-end H-mean on the arbitrarily-shaped Total-Text dataset, surpassing the previous state-of-the-art GLASS by 1.02% in full-lexicon accuracy without additional training data, and obtains competitive 83.4% strong-lexicon results on the multi-oriented ICDAR 2015 dataset.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 62 of its 75 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

62 of 75 references.

References · 62

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2020End-to-End Object Detection with Transformerscited by 7,384
  8. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  9. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  10. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  11. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 519
  12. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
38 more
  1. 2019Character Region Awareness for Text Detectioncited by 273
  2. 2019Mask TextSpotter: An End-to-End Trainable Neural Network for Spotting Text with Arbitrary Shapescited by 171
  3. 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
  4. 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
  5. 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
  6. 2016TextBoxes: A Fast Text Detector with a Single Deep Neural Networkcited by 119
  7. 2018TextSnake: A Flexible Representation for Detecting Text of Arbitrary Shapescited by 114
  8. 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
  9. 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
  10. 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
  11. 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
  12. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  13. 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
  14. 2025Dolphin: Document Image Parsing via Heterogeneous Anchor Promptingcited by 78
  15. 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
  16. 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
  17. 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
  18. 2022Text Spotting Transformerscited by 70
  19. 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 70
  20. 2019All You Need Is Boundary: Toward Arbitrary-Shaped Text Spottingcited by 66
  21. 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
  22. 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
  23. 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
  24. 2024Attentive Eraser: Unleashing Diffusion Model's Object Removal Potential via Self-Attention Redirection Guidancecited by 63
  25. 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
  26. 2019Towards Unconstrained End-to-End Text Spottingcited by 57
  27. 2024A Bounding Box is Worth One Token: Interleaving Layout and Text in a Large Language Model for Document Understandingcited by 57
  28. 2017Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networkscited by 56
  29. 2024Harmonizing Visual Text Comprehension and Generationcited by 54
  30. 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
  31. 2021ISTR: End-to-End Instance Segmentation with Transformerscited by 52
  32. 2020MANGO: A Mask Attention Guided One-Stage Scene Text Spottercited by 51
  33. 2018An end-to-end TextSpotter with Explicit Alignment and Attentioncited by 50
  34. 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
  35. 2021SPTS: Single-Point Text Spottingcited by 45
  36. 2024ParGo: Bridging Vision-Language with Partial and Global Viewscited by 40
  37. 2025Vision as LoRAcited by 37
  38. 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34

50 most cited of 62 All 62 (JSON)

Built on by

Not cited yet.