TiCLS : Tightly Coupled Language Text Spotter
Not on the map. Why?
Abstract (arXiv)
Scene text spotting aims to detect and recognize text in real-world images, where instances are often short, fragmented, or visually ambiguous. Existing methods primarily rely on visual cues and implicitly capture local character dependencies, but they overlook the benefits of external linguistic knowledge. Prior attempts to integrate language models either adapt language modeling objectives without external knowledge or apply pretrained models that are misaligned with the word-level granularity of scene text. We propose TiCLS, an end-to-end text spotter that explicitly incorporates external linguistic knowledge from a character-level pretrained language model. TiCLS introduces a linguistic decoder that fuses visual and linguistic features, yet can be initialized by a pretrained language model, enabling robust recognition of ambiguous or fragmented text. Experiments on ICDAR 2015 and Total-Text demonstrate that TiCLS achieves state-of-the-art performance, validating the effectiveness of PLM-guided linguistic integration for scene text spotting.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
31 of 44 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016Pointer Sentinel Mixture Modelscited by 2,992
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2017Focal Loss for Dense Object Detectioncited by 749
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2020ABCNet: Real-time Scene Text Spotting with Adaptive Bezier-Curve Networkcited by 170
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2017Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognitioncited by 161
19 more
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2019ICDAR2019 Robust Reading Challenge on Arbitrary-Shaped Text (RRC-ArT)cited by 147
- 2019ICDAR 2019 Competition on Large-scale Street View Text with Partial Labeling -- RRC-LSVTcited by 121
- 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
- 2018FOTS: Fast Oriented Text Spotting with a Unified Networkcited by 109
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2020MANGO: A Mask Attention Guided One-Stage Scene Text Spottercited by 51
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformercited by 29
- 2022Out-of-Vocabulary Challenge Reportcited by 11
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Samplingcited by 9
- 2025Hyper-Local Deformable Transformers for Text Spotting on Historical Mapscited by 7
- 2024SwinTextSpotter v2: Towards Better Synergy for Scene Text Spottingcited by 5
- 2024TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Modelcited by 5
- 2024FastTextSpotter: A High-Efficiency Transformer for Multilingual Scene Text Spottingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.