Real-time Scene Text Detection with Differentiable Binarization
Not on the map. Why?
Abstract (arXiv)
Recently, segmentation-based methods are quite popular in scene text detection, as the segmentation results can more accurately describe scene text of various shapes such as curve text. However, the post-processing of binarization is essential for segmentation-based detection, which converts probability maps produced by a segmentation method into bounding boxes/regions of text. In this paper, we propose a module named Differentiable Binarization (DB), which can perform the binarization process in a segmentation network. Optimized along with a DB module, a segmentation network can adaptively set the thresholds for binarization, which not only simplifies the post-processing but also enhances the performance of text detection. Based on a simple segmentation network, we validate the performance improvements of DB on five benchmark datasets, which consistently achieves state-of-the-art results, in terms of both detection accuracy and speed. In particular, with a light-weight backbone, the performance improvements by DB are significant so that we can look for an ideal tradeoff between detection accuracy and efficiency. Specifically, with a backbone of ResNet-18, our detector achieves an F-measure of 82.8, running at 62 FPS, on the MSRA-TD500 dataset. Code is available at: https://github.com/MhLiao/DB
Key facts. Cited by 214 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 40; 2023: 41; 2024: 45; 2025: 33; 2026: 21.
214 papers.
Sort:
By area:
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
- 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
- 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactionscited by 68
38 more
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2022DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformercited by 50
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
- 2023GeoLayoutLM: Geometric Pre-training for Visual Information Extractioncited by 40
- 2021PP-OCRv2: Bag of Tricks for Ultra Lightweight OCR Systemcited by 39
- 2022MaskOCR: Text Recognition with Masked Encoder-Decoder Pretrainingcited by 34
- 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
- 2024SoccerNet Game State Reconstruction: End-to-End Athlete Tracking and Identification on a Minimapcited by 34
- 2021MOST: A Multi-Oriented Scene Text Detector with Localization Refinementcited by 33
- 2022Optimal Boxes: Boosting End-to-End Scene Text Recognition by Adjusting Annotated Bounding Boxes via Reinforcement Learningcited by 33
- 2024Hi-SAM: Marrying Segment Anything Model for Hierarchical Text Segmentationcited by 30
- 2023ESTextSpotter: Towards Better Scene Text Spotting with Explicit Synergy in Transformercited by 29
- 2022Arbitrary Shape Text Detection via Boundary Transformercited by 28
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2023Towards Unified Scene Text Spotting based on Sequence Generationcited by 27
- 2021TPSNet: Reverse Thinking of Thin Plate Splines for Arbitrary Shape Scene Text Representationcited by 26
- 2021A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformercited by 26
- 2026JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generationcited by 25
- 2021De-rendering Stylized Textscited by 24
- 2021Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text Detectioncited by 23
- 2023ICDAR 2023 Competition on Hierarchical Text Detection and Recognitioncited by 23
- 2021Stroke-Based Scene Text Erasing Using Synthetic Data for Trainingcited by 20
- 2023ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Imagescited by 20
- 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
- 2023SOOD: Towards Semi-Supervised Oriented Object Detectioncited by 19
- 2023DocParser: End-to-end OCR-free Information Extraction from Visually Rich Documentscited by 19
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2022Kernel Proposal Network for Arbitrary Shape Text Detectioncited by 17
- 2021Industrial Scene Text Detection with Refined Feature-attentive Networkcited by 16
- 2023Deep Unrestricted Document Image Rectificationcited by 16
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
- 2021Scene Text Retrieval via Joint Text Detection and Similarity Learningcited by 15
- 2022Arbitrary Shape Text Detection via Segmentation with Probability Mapscited by 15
- 2021I3CL:Intra- and Inter-Instance Collaborative Learning for Arbitrary-shaped Scene Text Detectioncited by 14
50 most cited of 214 All 214 (JSON)
- 2026TextVBench: Evaluating Text Rendering and Preservation in Video Generation9 Oct 2026
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026Developing an OCR model for Extracting Information from Invoices with Korean Language17 Sep 2026
- 2026Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End12 Sep 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications23 Jun 2026
- 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation22 Jun 2026
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AI15 Jun 2026
- 2026PragyaDoc: A Universal Document Intelligence Framework for Multilingual Medical Document Understanding in Low-Resource Settings1 Jun 2026
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation14 May 2026
- 2026DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Models9 May 2026
38 more
- 2026Benchmarking OCR Pipelines with Adaptive Enhancement for Multi-Domain Retail Bill Digitization28 Apr 2026
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscation13 Apr 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026ET-SAM: Efficient Point Prompt Prediction in SAM for Unified Scene Text Detection and Layout Analysis26 Mar 2026
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2026IMTBench: A Multi-Scenario Cross-Modal Collaborative Evaluation Benchmark for In-Image Machine Translation11 Mar 2026
- 2026JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generation22 Feb 2026
- 2026Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interaction28 Jan 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2025Bharat Scene Text: A Novel Comprehensive Dataset and Benchmark for Indian Language Scene Text Understanding28 Nov 2025
- 2025ARIAL: An Agentic Framework for Document VQA with Precise Answer Localization22 Nov 2025
- 2025DKDS: A Benchmark Dataset of Degraded Kuzushiji Documents with Seals for Detection and Binarization12 Nov 2025
- 2025LRANet++: Low-Rank Approximation Network for Accurate and Efficient Text Spotting8 Nov 2025
- 2025ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents17 Oct 2025
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
- 2025ICDAR 2025 Competition on FEw-Shot Text line segmentation of ancient handwritten documents (FEST)16 Sep 2025
- 2025MobileRAG: Enhancing Mobile Agent with Retrieval-Augmented Generation4 Sep 2025
- 2025Why Stop at Words? Unveiling the Bigger Picture through Line-Level OCR29 Aug 2025
- 2025Clustering-based Feature Representation Learning for Oracle Bone Inscriptions Detection26 Aug 2025
- 2025EvTurb: Event Camera Guided Turbulence Removal14 Aug 2025
- 2025TRUDI and TITUS: A Multi-Perspective Dataset and A Three-Stage Recognition System for Transportation Unit Identification4 Aug 2025
- 2025Automated Label Placement on Maps via Large Language Models29 Jul 2025
- 2025Structured Captions Improve Prompt Adherence in Text-to-Image Models (Re-LAION-Caption 19M)7 Jul 2025
- 2025Class-Agnostic Region-of-Interest Matching in Document Images26 Jun 2025
- 2025Inverse Scene Text Removal26 Jun 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2025EdgeSpotter: Multi-Scale Dense Text Spotting for Industrial Panel Monitoring8 Jun 2025
- 2025Agent-SAMA: State-Aware Mobile Assistant29 May 2025
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understanding28 May 2025
- 2025GoMatching++: Parameter- and Data-Efficient Arbitrary-Shaped Video Text Spotting and Benchmarking28 May 2025
- 2025The Devil is in Fine-tuning and Long-tailed Problems:A New Benchmark for Scene Text Detection21 May 2025
- 2025From Broadcast to Minimap: Achieving State-of-the-Art SoccerNet Game State Reconstruction8 Apr 2025
- 2025Edge Approximation Text Detector5 Apr 2025
- 2025InkFM: A Foundational Model for Full-Page Online Handwritten Note Understanding29 Mar 2025
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusion26 Mar 2025
- 2025Precise Parameter Localization for Textual Generation in Diffusion Models14 Feb 2025
- 2025Billet Number Recognition Based on Test-Time Adaptation13 Feb 2025
50 newest of 214 All 214 (JSON)
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
- 2024UniFL: Improve Latent Diffusion Model via Unified Feedback Learningcited by 9
- 2024AnyTrans: Translate AnyText in the Image with Large Scale Modelscited by 8
- 2025Text-Aware Image Restoration with Diffusion Modelscited by 6
- 2023CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Modelcited by 5
- 2025Precise Parameter Localization for Textual Generation in Diffusion Modelscited by 5
- 2024Descanning: From Scanned to the Original Images with a Color Correction Diffusion Modelcited by 2
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Modelscited by 0
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2025Precise Parameter Localization for Textual Generation in Diffusion Models14 Feb 2025
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blending14 Oct 2024
- 2024AnyTrans: Translate AnyText in the Image with Large Scale Models17 Jun 2024
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Models3 Jun 2024
- 2024UniFL: Improve Latent Diffusion Model via Unified Feedback Learning8 Apr 2024
- 2024Descanning: From Scanned to the Original Images with a Color Correction Diffusion Model8 Feb 2024
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models28 Nov 2023
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov 2023
- 2023CCLAP: Controllable Chinese Landscape Painting Generation via Latent Diffusion Model9 Apr 2023
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Taskscited by 9
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusioncited by 8
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistantcited by 3
- 2025Exploring OCR-augmented Generation for Bilingual VQAcited by 1
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applicationscited by 1
- 2026DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Modelscited by 0
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spottingcited by 0
- 2026MEVL-STP: Multi-Encoder and Vision Language Model for Arbitrarily Shaped Scene Text Spotting23 Sep 2026
- 2026Are We There Yet? Exploring the Capabilities of MLLMs in Assistive AI Applications23 Jun 2026
- 2026DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Models9 May 2026
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2025Exploring OCR-augmented Generation for Bilingual VQA2 Oct 2025
- 2025MMMORRF: Multimodal Multilingual Modularized Reciprocal Rank Fusion26 Mar 2025
- 2024Visual Text Matters: Improving Text-KVQA with Visual Text Entity Knowledge-aware Large Multimodal Assistant24 Oct 2024
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understanding20 Nov 2023
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectors29 Apr 2022
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spotting8 Mar 2022
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Taskscited by 131
- 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactionscited by 68
- 2025Agent-SAMA: State-Aware Mobile Assistantcited by 12
- 2026Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interactioncited by 7
- 2025ARIAL: An Agentic Framework for Document VQA with Precise Answer Localizationcited by 2
- 2026Me-Agent: A Personalized Mobile Agent with Two-Level User Habit Learning for Enhanced Interaction28 Jan 2026
- 2025ARIAL: An Agentic Framework for Document VQA with Precise Answer Localization22 Nov 2025
- 2025Agent-SAMA: State-Aware Mobile Assistant29 May 2025
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan 2025
- 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactions5 Aug 2024
- 2025TextMamba: Scene Text Detector with Mambacited by 2
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
- 2022DiT: Self-supervised Pre-training for Document Image Transformercited by 152
- 2022MMRotate: A Rotated Object Detection Benchmark using PyTorchcited by 115
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Fourier Contour Embedding for Arbitrary-Shaped Text Detectioncited by 80
- 2024TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergycited by 71
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2022DPText-DETR: Towards Better Scene Text Detection with Dynamic Points in Transformercited by 50
- 2021Adaptive Boundary Proposal Network for Arbitrary Shape Text Detectioncited by 47
12 most cited of 185 All 185 (JSON)
- 2026TextVBench: Evaluating Text Rendering and Preservation in Video Generation9 Oct 2026
- 2026Developing an OCR model for Extracting Information from Invoices with Korean Language17 Sep 2026
- 2026Beyond OCR Accuracy: Text-Centric VQA Under Image Degradation with Modular and End-to-End12 Sep 2026
- 2026MonkeyOCRv2: A Visual-Text Foundation Model for Document AI13 Jul 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026From Reconstruction to Decision: A Post-Encoder Plug-in Adapter for Curvilinear Segmentation22 Jun 2026
- 2026PragyaDoc: A Universal Document Intelligence Framework for Multilingual Medical Document Understanding in Low-Resource Settings1 Jun 2026
- 2026InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation14 May 2026
- 2026Benchmarking OCR Pipelines with Adaptive Enhancement for Multi-Domain Retail Bill Digitization28 Apr 2026
- 2026Privacy-Preserving Structureless Visual Localization via Image Obfuscation13 Apr 2026
- 2026DocRevive: A Unified Pipeline for Document Text Restoration11 Apr 2026
- 2026ET-SAM: Efficient Point Prompt Prediction in SAM for Unified Scene Text Detection and Layout Analysis26 Mar 2026
12 newest of 185 All 185 (JSON)