Detecting Curve Text in the Wild: New Dataset and New Solution
Not on the map. Why?
Abstract (arXiv)
Scene text detection has been made great progress in recent years. The detection manners are evolving from axis-aligned rectangle to rotated rectangle and further to quadrangle. However, current datasets contain very little curve text, which can be widely observed in scene images such as signboard, product name and so on. To raise the concerns of reading curve text in the wild, in this paper, we construct a curve text dataset named CTW1500, which includes over 10k text annotations in 1,500 images (1000 for training and 500 for testing). Based on this dataset, we pioneering propose a polygon based curve text detector (CTD) which can directly detect curve text without empirical combination. Moreover, by seamlessly integrating the recurrent transverse and longitudinal offset connection (TLOC), the proposed method can be end-to-end trainable to learn the inherent connection among the position offsets. This allows the CTD to explore context information instead of predicting points independently, resulting in more smooth and accurate detection. We also propose two simple but effective post-processing methods named non-polygon suppress (NPS) and polygonal non-maximum suppression (PNMS) to further improve the detection accuracy. Furthermore, the proposed approach in this paper is designed in an universal manner, which can also be trained with rectangular or quadrilateral bounding boxes without extra efforts. Experimental results on CTW-1500 demonstrate our method with only a light backbone can outperform state-of-the-art methods with a large margin. By evaluating only in the curve or non-curve subset, the CTD + TLOC can still achieve the best results. Code is available at https://github.com/Yuliang-Liu/Curve-Text-Detector.
Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 19; 2023: 9; 2024: 21; 2025: 10; 2026: 3.
82 papers.
Sort:
By area:
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 114
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 80
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2021Open Images V5 Text Annotation and Yet Another Mask Text Spottercited by 46
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
38 more
- 2024Visual Text Generation in the Wildcited by 22
- 2021A Multiplexed Network for End-to-End, Multilingual OCRcited by 18
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2022Kernel Proposal Network for Arbitrary Shape Text Detectioncited by 17
- 2022Arbitrary Shape Text Detection via Segmentation with Probability Mapscited by 15
- 2021I3CL:Intra- and Inter-Instance Collaborative Learning for Arbitrary-shaped Scene Text Detectioncited by 14
- 2024Exploring the Capabilities of Large Multimodal Models on Dense Textcited by 14
- 2021CentripetalText: An Efficient Text Instance Representation for Scene Text Detectioncited by 13
- 2025A Token-level Text Image Foundation Model for Document Understandingcited by 13
- 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understandingcited by 12
- 2022Text Growing on Leafcited by 11
- 2023Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Promptcited by 11
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
- 2024Out of Length Text Recognition with Sub-String Matchingcited by 11
- 2024Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidancecited by 11
- 2021FAST: Faster Arbitrarily-Shaped Text Detector with Minimalist Kernel Representationcited by 9
- 2023Hierarchical Text Spotter for Joint Text Spotting and Layout Analysiscited by 8
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Reviewcited by 8
- 2021All You Need is a Second Look: Towards Arbitrary-Shaped Text Detectioncited by 7
- 2021ARTS: Eliminating Inconsistency between Text Detection and Recognition with Auto-Rectification Text Spottercited by 7
- 2022Graph Fusion Network for Multi-Oriented Object Detectioncited by 7
- 2022Zoom Text Detectorcited by 7
- 2023An Empirical Study of Scaling Law for OCRcited by 7
- 2022Arbitrary Shape Text Detection using Transformerscited by 6
- 2022Contextual Text Block Detection towards Scene Text Understandingcited by 6
- 2022CBNet: A Plug-and-Play Network for Segmentation-Based Scene Text Detectioncited by 6
- 2021Detection and Rectification of Arbitrary Shaped Scene Texts by using Text Keypoints and Linkscited by 5
- 2021BiP-Net: Bidirectional Perspective Strategy based Arbitrary-Shaped Text Detection Networkcited by 5
- 2022On Web-based Visual Corpus Construction for Visual Document Understandingcited by 5
- 2024TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Modelcited by 5
- 2025Text-Aware Image Restoration with Diffusion Modelscited by 5
- 2021CORE-Text: Improving Scene Text Detection with Contrastive Relational Reasoningcited by 4
- 2022A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognitioncited by 4
- 2023DISGO: Automatic End-to-End Evaluation for Scene Text OCRcited by 4
- 2024Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentationcited by 4
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Cameracited by 4
- 2022Task Grouping for Multilingual Text Recognitioncited by 3
- 2025Edge Approximation Text Detectorcited by 3
50 most cited of 82 All 82 (JSON)
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Xuanwu: Evolving General Multimodal Models into an Industrial-Grade Foundation for Content Ecosystems31 Mar 2026
- 2026PositionOCR: Augmenting Positional Awareness in Multi-Modal Models via Hybrid Specialist Integration22 Feb 2026
- 2025Automatic Intermodal Loading Unit Identification using Computer Vision: A Scoping Review22 Sep 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understanding5 Jun 2025
- 2025The Devil is in Fine-tuning and Long-tailed Problems:A New Benchmark for Scene Text Detection21 May 2025
- 2025Advancing Sequential Numerical Prediction in Autoregressive Models19 May 2025
- 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding8 May 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025A Token-level Text Image Foundation Model for Document Understanding4 Mar 2025
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review23 Feb 2025
38 more
- 2025SceneVTG++: Controllable Multilingual Visual Text Generation in the Wild6 Jan 2025
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning31 Dec 2024
- 2024Hear the Scene: Audio-Enhanced Text Spotting27 Dec 2024
- 2024Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidance13 Dec 2024
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacy3 Dec 2024
- 2024Focus Entirety and Perceive Environment for Arbitrary-Shaped Text Detection25 Sep 2024
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera25 Sep 2024
- 2024Region Prompt Tuning: Fine-grained Scene Text Detection Utilizing Region Text Prompt20 Sep 2024
- 2024Platypus: A Generalized Specialist Model for Reading Text in Various Forms27 Aug 2024
- 2024Visual Text Generation in the Wild19 Jul 2024
- 2024Out of Length Text Recognition with Sub-String Matching17 Jul 2024
- 2024Artistic-style text detector and a new Movie-Poster dataset24 Jun 2024
- 2024SegHist: A General Segmentation-based Framework for Chinese Historical Document Text Line Detection17 Jun 2024
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyond31 May 2024
- 2024Unsupervised Pre-training with Language-Vision Prompts for Low-Data Instance Segmentation22 May 2024
- 2024CustomText: Customized Textual Image Generation using Diffusion Models21 May 2024
- 2024Text Grouping Adapter: Adapting Pre-trained Text Detector for Layout Analysis13 May 2024
- 2024Exploring the Capabilities of Large Multimodal Models on Dense Text9 May 2024
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want29 Mar 2024
- 2024TextBlockV2: Towards Precise-Detection-Free Scene Text Spotting with Pre-trained Language Model15 Mar 2024
- 2024CPN: Complementary Proposal Network for Unconstrained Text Detection18 Feb 2024
- 2024Dynamic Relation Transformer for Contextual Text Block Detection17 Jan 2024
- 2023An Empirical Study of Scaling Law for OCR29 Dec 2023
- 2023Hierarchical Text Spotter for Joint Text Spotting and Layout Analysis25 Oct 2023
- 2023STEP -- Towards Structured Scene-Text Spotting5 Sep 2023
- 2023DISGO: Automatic End-to-End Evaluation for Scene Text OCR25 Aug 2023
- 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World3 Aug 2023
- 2023RusTitW: Russian Language Text Dataset for Visual Text in-the-Wild Recognition29 Mar 2023
- 2023Deformable Kernel Expansion Model for Efficient Arbitrary-shaped Scene Text Detection28 Mar 2023
- 2023Augmented Transformers with Adaptive n-grams Embedding for Multilingual Scene Text Recognition28 Feb 2023
- 2023Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Prompt2 Feb 2023
- 2022A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognition27 Dec 2022
- 2022CBNet: A Plug-and-Play Network for Segmentation-Based Scene Text Detection5 Dec 2022
- 2022On Web-based Visual Corpus Construction for Visual Document Understanding7 Nov 2022
- 2022Task Grouping for Multilingual Text Recognition13 Oct 2022
- 2022Text Growing on Leaf7 Sep 2022
- 2022Zoom Text Detector7 Sep 2022
- 2022Transformers in Remote Sensing: A Survey2 Sep 2022
50 newest of 82 All 82 (JSON)
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoningcited by 165
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacycited by 80
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2024Exploring the Capabilities of Large Multimodal Models on Dense Textcited by 14
- 2025A Token-level Text Image Foundation Model for Document Understandingcited by 13
- 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understandingcited by 12
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyondcited by 11
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Reviewcited by 8
- 2026PositionOCR: Augmenting Positional Awareness in Multi-Modal Models via Hybrid Specialist Integrationcited by 0
- 2026PositionOCR: Augmenting Positional Awareness in Multi-Modal Models via Hybrid Specialist Integration22 Feb 2026
- 2025When Semantics Mislead Vision: Mitigating Large Multimodal Models Hallucinations in Scene Text Spotting and Understanding5 Jun 2025
- 2025A Token-level Text Image Foundation Model for Document Understanding4 Mar 2025
- 2025Multimodal Large Language Models for Text-rich Image Understanding: A Comprehensive Review23 Feb 2025
- 2024OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning31 Dec 2024
- 2024CC-OCR: A Comprehensive and Challenging OCR Benchmark for Evaluating Large Multimodal Models in Literacy3 Dec 2024
- 2024StrucTexTv3: An Efficient Vision-Language Model for Text-rich Image Perception, Comprehension, and Beyond31 May 2024
- 2024Exploring the Capabilities of Large Multimodal Models on Dense Text9 May 2024
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want29 Mar 2024
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectors29 Apr 2022
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting8 Mar 2022
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2024CustomText: Customized Textual Image Generation using Diffusion Models21 May 2024
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 114
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2021Open Images V5 Text Annotation and Yet Another Mask Text Spottercited by 46
- 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
- 2024Visual Text Generation in the Wildcited by 22
- 2021A Multiplexed Network for End-to-End, Multilingual OCRcited by 18
- 2022Kernel Proposal Network for Arbitrary Shape Text Detectioncited by 17
- 2022Arbitrary Shape Text Detection via Segmentation with Probability Mapscited by 15
12 most cited of 69 All 69 (JSON)
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Xuanwu: Evolving General Multimodal Models into an Industrial-Grade Foundation for Content Ecosystems31 Mar 2026
- 2025Automatic Intermodal Loading Unit Identification using Computer Vision: A Scoping Review22 Sep 2025
- 2025The Devil is in Fine-tuning and Long-tailed Problems:A New Benchmark for Scene Text Detection21 May 2025
- 2025Advancing Sequential Numerical Prediction in Autoregressive Models19 May 2025
- 2025Adaptive Markup Language Generation for Contextually-Grounded Visual Document Understanding8 May 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025SceneVTG++: Controllable Multilingual Visual Text Generation in the Wild6 Jan 2025
- 2024Hear the Scene: Audio-Enhanced Text Spotting27 Dec 2024
- 2024Arbitrary Reading Order Scene Text Spotter with Local Semantics Guidance13 Dec 2024
- 2024Focus Entirety and Perceive Environment for Arbitrary-Shaped Text Detection25 Sep 2024
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera25 Sep 2024
12 newest of 69 All 69 (JSON)