All You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting
Not on the map. Why?
Abstract (arXiv)
Recently, end-to-end text spotting that aims to detect and recognize text from cluttered images simultaneously has received particularly growing interest in computer vision. Different from the existing approaches that formulate text detection as bounding box extraction or instance segmentation, we localize a set of points on the boundary of each text instance. With the representation of such boundary points, we establish a simple yet effective scheme for end-to-end text spotting, which can read the text of arbitrary shapes. Experiments on three challenging datasets, including ICDAR2015, TotalText and COCO-Text demonstrate that the proposed method consistently surpasses the state-of-the-art in both scene text detection and end-to-end text recognition tasks.
Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 17; 2023: 12; 2024: 12; 2025: 5; 2026: 2.
66 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022Text Spotting Transformerscited by 70
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
38 more
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformercited by 29
- 2022Arbitrary Shape Text Detection via Boundary Transformercited by 28
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2021TPSNet: Reverse Thinking of Thin Plate Splines for Arbitrary Shape Scene Text Representationcited by 26
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Modelscited by 23
- 2021Scene Text Retrieval via Joint Text Detection and Similarity Learningcited by 15
- 2022Arbitrary Shape Text Detection via Segmentation with Probability Mapscited by 15
- 2021I3CL:Intra- and Inter-Instance Collaborative Learning for Arbitrary-shaped Scene Text Detectioncited by 14
- 2021CentripetalText: An Efficient Text Instance Representation for Scene Text Detectioncited by 13
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Textscited by 13
- 2022Text Growing on Leafcited by 11
- 2024DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Trainingcited by 11
- 2022Knowledge Mining with Scene Text for Fine-Grained Recognitioncited by 10
- 2023Turning a CLIP Model into a Scene Text Spottercited by 9
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Samplingcited by 9
- 2024Bridging the Gap Between End-to-End and Two-Step Text Spottingcited by 9
- 2023TextSLAM: Visual SLAM with Semantic Planar Text Featurescited by 8
- 2021All You Need is a Second Look: Towards Arbitrary-Shaped Text Detectioncited by 7
- 2021ARTS: Eliminating Inconsistency between Text Detection and Recognition with Auto-Rectification Text Spottercited by 7
- 2022A Survey on Visual Transfer Learning using Knowledge Graphscited by 7
- 2022DEER: Detection-agnostic End-to-End Recognizer for Scene Text Spottingcited by 7
- 2022Zoom Text Detectorcited by 7
- 2023DeepSolo++: Let Transformer Decoder with Explicit Points Solo for Multilingual Text Spottingcited by 7
- 2024InstructOCR: Instruction Boosting Scene Text Spottingcited by 7
- 2025Hyper-Local Deformable Transformers for Text Spotting on Historical Mapscited by 7
- 2022TRIE++: Towards End-to-End Information Extraction from Visually Rich Documentscited by 6
- 2022CBNet: A Plug-and-Play Network for Segmentation-Based Scene Text Detectioncited by 6
- 2021Detection and Rectification of Arbitrary Shaped Scene Texts by using Text Keypoints and Linkscited by 5
- 2021Implicit Feature Alignment: Learn to Convert Text Recognizer to Text Spottercited by 5
- 2024SwinTextSpotter v2: Towards Better Synergy for Scene Text Spottingcited by 5
- 2024SignEye: Traffic Sign Interpretation from Vehicle First-Person Viewcited by 5
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Cameracited by 4
- 2023PBFormer: Capturing Complex Scene Text Shape with Polynomial Band Transformercited by 3
- 2024WeCromCL: Weakly Supervised Cross-Modality Contrastive Learning for Transcription-only Supervised Text Spottingcited by 3
- 2024Partial Scene Text Retrievalcited by 3
- 2025Edge Approximation Text Detectorcited by 3
50 most cited of 66 All 66 (JSON)
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2025Hyper-Local Deformable Transformers for Text Spotting on Historical Maps17 Jun 2025
- 2025SemiETS: Integrating Spatial and Content Consistencies for Semi-Supervised End-to-end Text Spotting14 Apr 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition19 Mar 2025
- 2025OmniParser V2: Structured-Points-of-Thought for Unified Visual Text Parsing and Its Generality to Multimodal Large Language Models22 Feb 2025
- 2024Hear the Scene: Audio-Enhanced Text Spotting27 Dec 2024
- 2024InstructOCR: Instruction Boosting Scene Text Spotting20 Dec 2024
- 2024SignEye: Traffic Sign Interpretation from Vehicle First-Person View18 Nov 2024
- 2024Partial Scene Text Retrieval15 Nov 2024
- 2024Focus Entirety and Perceive Environment for Arbitrary-Shaped Text Detection25 Sep 2024
38 more
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera25 Sep 2024
- 2024DNTextSpotter: Arbitrary-Shaped Scene Text Spotting via Improved Denoising Training1 Aug 2024
- 2024WeCromCL: Weakly Supervised Cross-Modality Contrastive Learning for Transcription-only Supervised Text Spotting28 Jul 2024
- 2024Bridging the Gap Between End-to-End and Two-Step Text Spotting6 Apr 2024
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognition28 Mar 2024
- 2024SwinTextSpotter v2: Towards Better Synergy for Scene Text Spotting15 Jan 2024
- 2024Inverse-like Antagonistic Scene Text Spotting via Reading-Order Estimation and Dynamic Sampling8 Jan 2024
- 2023Box2Poly: Memory-Efficient Polygon Prediction of Arbitrarily Shaped and Rotated Text20 Sep 2023
- 2023PBFormer: Capturing Complex Scene Text Shape with Polynomial Band Transformer29 Aug 2023
- 2023Turning a CLIP Model into a Scene Text Spotter21 Aug 2023
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformer20 Aug 2023
- 2023When Measures are Unreliable: Imperceptible Adversarial Perturbations toward Top-k Multi-Label Learning27 Jul 2023
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks11 Jun 2023
- 2023TextFormer: A Query-based End-to-End Text Spotter with Mixed Supervision6 Jun 2023
- 2023DeepSolo++: Let Transformer Decoder with Explicit Points Solo for Multilingual Text Spotting31 May 2023
- 2023TextSLAM: Visual SLAM with Semantic Planar Text Features17 May 2023
- 2023VGTS: Visually Guided Text Spotting for Novel Categories in Historical Manuscripts3 Apr 2023
- 2023Geometric Perception based Efficient Text Recognition8 Feb 2023
- 2023SPTS v2: Single-Point Scene Text Spotting4 Jan 2023
- 2022CBNet: A Plug-and-Play Network for Segmentation-Based Scene Text Detection5 Dec 2022
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting19 Nov 2022
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting19 Nov 2022
- 2022Text Growing on Leaf7 Sep 2022
- 2022Zoom Text Detector7 Sep 2022
- 2022Arbitrary Shape Text Detection via Segmentation with Probability Maps26 Aug 2022
- 2022Single Shot Self-Reliant Scene Text Spotter by Decoupled yet Collaborative Detection and Recognition15 Jul 2022
- 2022TRIE++: Towards End-to-End Information Extraction from Visually Rich Documents14 Jul 2022
- 2022Dynamic Low-Resolution Distillation for Cost-Efficient End-to-End Text Spotting14 Jul 2022
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Texts11 Jul 2022
- 2022Arbitrary Shape Text Detection via Boundary Transformer11 May 2022
- 2022Text Spotting Transformers5 Apr 2022
- 2022Knowledge Mining with Scene Text for Fine-Grained Recognition27 Mar 2022
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition19 Mar 2022
- 2022DEER: Detection-agnostic End-to-End Recognizer for Scene Text Spotting10 Mar 2022
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting8 Mar 2022
- 2022A Survey on Visual Transfer Learning using Knowledge Graphs27 Jan 2022
- 2021SPTS: Single-Point Text Spotting15 Dec 2021
- 2021TPSNet: Reverse Thinking of Thin Plate Splines for Arbitrary Shape Scene Text Representation25 Oct 2021
50 newest of 66 All 66 (JSON)
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 171
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2024OmniParser: A Unified Framework for Text Spotting, Key Information Extraction and Table Recognitioncited by 74
- 2023A Comprehensive Survey on Applications of Transformers for Deep Learning Taskscited by 71
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022Text Spotting Transformerscited by 70
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
- 2021SPTS: Single-Point Text Spottingcited by 45
12 most cited of 63 All 63 (JSON)
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2025Hyper-Local Deformable Transformers for Text Spotting on Historical Maps17 Jun 2025
- 2025SemiETS: Integrating Spatial and Content Consistencies for Semi-Supervised End-to-end Text Spotting14 Apr 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025A Lightweight Context-Driven Training-Free Network for Scene Text Segmentation and Recognition19 Mar 2025
- 2024Hear the Scene: Audio-Enhanced Text Spotting27 Dec 2024
- 2024InstructOCR: Instruction Boosting Scene Text Spotting20 Dec 2024
- 2024SignEye: Traffic Sign Interpretation from Vehicle First-Person View18 Nov 2024
- 2024Partial Scene Text Retrieval15 Nov 2024
- 2024Focus Entirety and Perceive Environment for Arbitrary-Shaped Text Detection25 Sep 2024
- 2024Spotlight Text Detector: Spotlight on Candidate Regions Like a Camera25 Sep 2024
12 newest of 63 All 63 (JSON)