Character Region Awareness for Text Detection
Not on the map. Why?
Abstract (arXiv)
Scene text detection methods based on neural networks have emerged recently and have shown promising results. Previous methods trained with rigid word-level bounding boxes exhibit limitations in representing the text region in an arbitrary shape. In this paper, we propose a new scene text detection method to effectively detect text area by exploring each character and affinity between characters. To overcome the lack of individual character level annotations, our proposed framework exploits both the given character-level annotations for synthetic images and the estimated character-level ground-truths for real images acquired by the learned interim model. In order to estimate affinity between characters, the network is trained with the newly proposed representation for affinity. Extensive experiments on six benchmarks, including the TotalText and CTW-1500 datasets which contain highly curved texts in natural images, demonstrate that our character-level text detection significantly outperforms the state-of-the-art detectors. According to the results, our proposed method guarantees high flexibility in detecting complicated scene text images, such as arbitrarily-oriented, curved, or deformed texts.
Key facts. Cited by 273 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 46; 2022: 61; 2023: 44; 2024: 53; 2025: 39; 2026: 30.
273 papers.
Sort:
By area:
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021OCR-free Document Understanding Transformercited by 400
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 153
- 2024Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenizationcited by 98
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
38 more
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 76
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2022Text Spotting Transformerscited by 70
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 68
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2021LayoutParser: A Unified Toolkit for Deep Learning Based Document Image Analysiscited by 58
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 52
- 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 52
- 2022DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformercited by 50
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
- 2021MOST: A Multi-Oriented Scene Text Detector with Localization Refinementcited by 33
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2023FuseCap: Leveraging Large Language Models for Enriched Fused Image Captionscited by 33
- 2022OCR-VQGAN: Taming Text-within-Image Generationcited by 31
- 2024Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentationcited by 30
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformercited by 29
- 2022Arbitrary Shape Text Detection via Boundary Transformercited by 28
- 2024Harnessing Webpage UIs for Text-Rich Visual Understandingcited by 28
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2023Towards Unified Scene Text Spotting based on Sequence Generationcited by 27
- 2021TPSNet: Reverse Thinking of Thin Plate Splines for Arbitrary Shape Scene Text Representationcited by 26
- 2021Towards Accurate Text-based Image Captioning with Content Diversity Explorationcited by 25
- 2024FakingRecipe: Detecting Fake News on Short Video Platforms from the Perspective of Creative Processcited by 25
- 2021De-rendering Stylized Textscited by 24
- 2021Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text Detectioncited by 23
- 2022End-to-End Video Text Spotting with Transformercited by 21
- 2021Stroke-Based Scene Text Erasing Using Synthetic Data for Trainingcited by 20
- 2022WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Modelscited by 20
- 2023ECG-Image-Kit: A Synthetic Image Generation Toolbox to Facilitate Deep Learning-Based Electrocardiogram Digitizationcited by 20
- 2025LayerD: Decomposing Raster Graphic Designs into Layerscited by 20
50 most cited of 273 All 273 (JSON)
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End12 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026OCR-Based Field Extraction for Archaeological Pottery Metadata: The CENTURIA Dataset31 Aug 2026
- 2026Automated pipeline for herbarium label digitization25 Aug 2026
- 2026What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptation22 Aug 2026
- 2026Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts19 Aug 2026
- 2026Mapping Armenian Paris: Extracting and Geocoding Commercial Advertisements from the 20th-Century Diaspora Press6 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
- 2026A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation3 Jul 2026
- 2026Cross-Temporal Sinhala OCR: Page-Level Adaptation and Diachronic Analysis28 Jun 2026
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptions27 Jun 2026
38 more
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications23 Jun 2026
- 2026FlowCodec: One-Step Flow Prior for Generative Image Compression19 Jun 2026
- 2026PragyaDoc: A Universal Document Intelligence Framework for Multilingual Medical Document Understanding in Low-Resource Settings1 Jun 2026
- 2026Comparative Evaluation of Machine Translation Systems on Images with Text28 May 2026
- 2026Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer26 May 2026
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026See Silhouettes in Motion with Neuromorphic Vision18 May 2026
- 2026Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models13 May 2026
- 2026What Matters in Practical Learned Image Compression6 May 2026
- 2026SynthPID: P&ID digitization from Topology-Preserving Synthetic Data15 Apr 2026
- 2026TRACE: Structure-Aware Character Encoding for Robust and Generalizable Document Watermarking13 Mar 2026
- 2026Designing Production-Scale OCR for India: Multilingual and Domain-Specific Systems18 Feb 2026
- 2026MotionWeaver: Holistic 4D-Anchored Framework for Multi-Humanoid Image Animation11 Feb 2026
- 2026Interfaze: The Future of AI is built on Task-Specific Small Models4 Feb 2026
- 2026Trailer Reimagined: An Innovative, Llm-DRiven, Expressive Automated Movie Summary framework (TRAILDREAMS)2 Feb 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2026WildRayZer: Self-supervised Large View Synthesis in Dynamic Environments15 Jan 2026
- 2026Show, don't tell -- Providing Visual Error Feedback for Handwritten Documents14 Jan 2026
- 2025Text images processing system using artificial intelligence models12 Dec 2025
- 2025REST: Diffusion-based Real-time End-to-end Streaming Talking Head Generation via ID-Context Caching and Asynchronous Streaming Distillation12 Dec 2025
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2025Bharat Scene Text: A Novel Comprehensive Dataset and Benchmark for Indian Language Scene Text Understanding28 Nov 2025
- 2025CharDiff-LP: A Diffusion Model with Character-Level Guidance for License Plate Image Restoration20 Oct 2025
- 2025Automated document processing system for government agencies using DBNET++ and BART models15 Oct 2025
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
- 2025From Videos to Indexed Knowledge Graphs -- Framework to Marry Methods for Multimodal Content Analysis and Understanding1 Oct 2025
- 2025LayerD: Decomposing Raster Graphic Designs into Layers29 Sep 2025
- 2025Human + AI for Accelerating Ad Localization Evaluation16 Sep 2025
- 2025Exploring Light-Weight Object Recognition for Real-Time Document Detection7 Sep 2025
- 2025Why Stop at Words? Unveiling the Bigger Picture through Line-Level OCR29 Aug 2025
- 2025Clustering-based Feature Representation Learning for Oracle Bone Inscriptions Detection26 Aug 2025
- 2025Improving OCR using internal document redundancy20 Aug 2025
- 2025Scaling Up Audio-Synchronized Visual Animation: An Efficient Training Paradigm5 Aug 2025
- 2025SAViL-Det: Semantic-Aware Vision-Language Model for Multi-Script Text Detection27 Jul 2025
- 2025Zero-shot OCR Accuracy of Low-Resourced Languages: A Comparative Analysis on Sinhala and Tamil24 Jul 2025
- 2025TextPixs: Glyph-Conditioned Diffusion with Character-Aware Attention and OCR-Guided Supervision8 Jul 2025
- 2025Inverse Scene Text Removal26 Jun 2025
- 2025FaSTA^*: Fast-Slow Toolpath Agent with Subroutine Mining for Efficient Multi-turn Image Editing26 Jun 2025
50 newest of 273 All 273 (JSON)
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2024Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenizationcited by 98
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspectivecited by 73
- 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 52
- 2023FuseCap: Leveraging Large Language Models for Enriched Fused Image Captionscited by 33
- 2024Harnessing Webpage UIs for Text-Rich Visual Understandingcited by 28
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2025Seeing is Believing? Mitigating OCR Hallucinations in Multimodal Large Language Modelscited by 12
- 2024Toward Interactive Regional Understanding in Vision-Large Language Modelscited by 9
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistantcited by 3
12 most cited of 15 All 15 (JSON)
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications23 Jun 2026
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
- 2025SAViL-Det: Semantic-Aware Vision-Language Model for Multi-Script Text Detection27 Jul 2025
- 2025Seeing is Believing? Mitigating OCR Hallucinations in Multimodal Large Language Models25 Jun 2025
- 2025SkyReels-V2: Infinite-length Film Generative Model17 Apr 2025
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant24 Oct 2024
- 2024Harnessing Webpage UIs for Text-Rich Visual Understanding17 Oct 2024
- 2024From Pixels to Prose: A Large Dataset of Dense Image Captions14 Jun 2024
- 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective26 May 2024
- 2024Toward Interactive Regional Understanding in Vision-Large Language Models27 Mar 2024
- 2024Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional Tokenization5 Feb 2024
- 2023FuseCap: Leveraging Large Language Models for Enriched Fused Image Captions28 May 2023
12 newest of 15 All 15 (JSON)
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 76
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
- 2024Long Video Diffusion Generation with Segmented Cross-Attention and Content-Rich Video Data Curationcited by 12
- 2025CoSTAast: Cost-Sensitive Toolpath Agent for Multi-turn Image Editingcited by 5
- 2025REST: Diffusion-based Real-time End-to-end Streaming Talking Head Generation via ID-Context Caching and Asynchronous Streaming Distillationcited by 4
- 2024CustomText: Customized Textual Image Generation using Diffusion Modelscited by 2
- 2025TextPixs: Glyph-Conditioned Diffusion with Character-Aware Attention and OCR-Guided Supervisioncited by 2
- 2024TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Imagescited by 0
- 2025CharDiff-LP: A Diffusion Model with Character-Level Guidance for License Plate Image Restorationcited by 0
- 2026TRACE: Structure-Aware Character Encoding for Robust and Generalizable Document Watermarkingcited by 0
- 2026Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfercited by 0
- 2026FlowCodec: One-Step Flow Prior for Generative Image Compressioncited by 0
- 2026FlowCodec: One-Step Flow Prior for Generative Image Compression19 Jun 2026
- 2026Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer26 May 2026
- 2026TRACE: Structure-Aware Character Encoding for Robust and Generalizable Document Watermarking13 Mar 2026
- 2025REST: Diffusion-based Real-time End-to-end Streaming Talking Head Generation via ID-Context Caching and Asynchronous Streaming Distillation12 Dec 2025
- 2025CharDiff-LP: A Diffusion Model with Character-Level Guidance for License Plate Image Restoration20 Oct 2025
- 2025TextPixs: Glyph-Conditioned Diffusion with Character-Aware Attention and OCR-Guided Supervision8 Jul 2025
- 2025CoSTAast: Cost-Sensitive Toolpath Agent for Multi-turn Image Editing13 Mar 2025
- 2024Long Video Diffusion Generation with Segmented Cross-Attention and Content-Rich Video Data Curation2 Dec 2024
- 2024TextDestroyer: A Training- and Annotation-Free Diffusion Method for Destroying Anomal Text from Images1 Nov 2024
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Models3 Jun 2024
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagation29 May 2024
- 2024CustomText: Customized Textual Image Generation using Diffusion Models21 May 2024
- 2025TextMamba: Scene Text Detector with Mambacited by 2
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2021OCR-free Document Understanding Transformercited by 400
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 153
- 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2024OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generationcited by 77
- 2022Text Spotting Transformerscited by 70
- 2024ToonCrafter: Generative Cartoon Interpolationcited by 68
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 68
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
12 most cited of 240 All 240 (JSON)
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End12 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026OCR-Based Field Extraction for Archaeological Pottery Metadata: The CENTURIA Dataset31 Aug 2026
- 2026Automated pipeline for herbarium label digitization25 Aug 2026
- 2026What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptation22 Aug 2026
- 2026Impact of Iterative Fine-Tuning on Transcription Accuracy in Complex Historical Sanskrit Manuscripts19 Aug 2026
- 2026Mapping Armenian Paris: Extracting and Geocoding Commercial Advertisements from the 20th-Century Diaspora Press6 Aug 2026
- 2026GUI-Lens: Coarse-to-Fine Cropping for GUI Grounding with General-Purpose VLMs4 Aug 2026
- 2026A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation3 Jul 2026
- 2026Cross-Temporal Sinhala OCR: Page-Level Adaptation and Diachronic Analysis28 Jun 2026
- 2026EpiSAM: Character Segmentation in Challenging Stone Inscriptions27 Jun 2026
12 newest of 240 All 240 (JSON)