Synthetic Data for Text Localisation in Natural Images
Not on the map. Why?
Cited by 25 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper we introduce a new method for text detection in natural images. The method comprises two contributions: First, a fast and scalable engine to generate synthetic images of text in clutter. This engine overlays synthetic text to existing background images in a natural way, accounting for the local 3D scene geometry. Second, we use the synthetic images to train a Fully-Convolutional Regression Network (FCRN) which efficiently performs text detection and bounding-box regression at all locations and multiple scales in an image. We discuss the relation of FCRN to the recently-introduced YOLO detector, as well as other end-to-end object detection systems based on deep learning. The resulting detection network significantly out performs current methods for text detection in natural images, achieving an F-measure of 84.2% on the standard ICDAR 2013 benchmark. Furthermore, it can process 15 images per second on a GPU.
Key facts. Cited by 396 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 83; 2022: 85; 2023: 80; 2024: 64; 2025: 48; 2026: 36.
396 papers.
Sort:
By area:
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2021OCR-free Document Understanding Transformercited by 400
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
38 more
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2024Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performancecited by 94
- 2023REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformerscited by 93
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
- 2021Vision Transformer for Fast and Efficient Scene Text Recognitioncited by 81
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2021PAN++: Towards Efficient and Accurate End-to-End Spotting of Arbitrarily-Shaped Textcited by 65
- 2022Few Could Be Better Than All: Feature Sampling and Grouping for Scene Text Detectioncited by 65
- 2021What If We Only Use Real Datasets for Scene Text Recognition? Toward Scene Text Recognition With Fewer Labelscited by 63
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2023DocILE Benchmark for Document Information Localization and Extractioncited by 58
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2022Disentangling visual and written concepts in CLIPcited by 57
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2025Scalable Vision Language Model Training via High Quality Data Curationcited by 54
- 2021PGNet: Real-time Arbitrarily-Shaped Text Spotting with Point Gathering Networkcited by 49
- 2025Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videoscited by 49
- 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 48
- 2021Open Images V5 Text Annotation and Yet Another Mask Text Spottercited by 46
- 2021Rethinking Text Line Recognition Modelscited by 45
- 2021SPTS: Single-Point Text Spottingcited by 45
- 2022Reading and Writing: Discriminative and Generative Modeling for Self-Supervised Text Recognitioncited by 45
- 2022Toward Understanding WordArt: Corner-Guided Transformer for Scene Text Recognitioncited by 45
- 2023Revisiting Scene Text Recognition: A Data Perspectivecited by 45
- 2023Turning a CLIP Model into a Scene Text Detectorcited by 44
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2024Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extractioncited by 44
- 2021SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Modelscited by 43
- 2021PIMNet: A Parallel, Iterative and Mimicking Network for Scene Text Recognitioncited by 41
- 2022Towards Weakly-Supervised Text Spotting using a Multi-Task Transformercited by 41
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Modelcited by 41
- 2022ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spottingcited by 40
- 2023DTrOCR: Decoder-only Transformer for Optical Character Recognitioncited by 40
- 2021Text Prior Guided Scene Text Image Super-resolutioncited by 37
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2021CDistNet: Perceiving Multi-Domain Character Distance for Robust Text Recognitioncited by 36
50 most cited of 396 All 396 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation29 Sep 2026
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts21 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026Confidence-Aware Ensemble and Long-Word Refinement for Artistic Text Recognition30 Aug 2026
- 2026Out-of-Length Scene Text Recognition: A Two-Axis Diagnosis and a Training-Free Fix25 Jul 2026
- 2026Persian Pixel: A large-scale synthetic OCR dataset for Persian language22 Jul 2026
- 2026StepX-Edge: An On-Device UI Vision-Language Model via Architecture-Training-Deployment Co-Design20 Jul 2026
- 20262D Rotary Position Embedding for Scene Text Recognition with Transformers15 Jul 2026
- 2026Metric-Guided Synthetic Image Data Rendering for Deep Learning compatible with Agentic AI14 Jul 2026
- 2026TextileNet: Towards Zero-shot Text-style Segmentation of Manuscripts10 Jul 2026
38 more
- 2026FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection9 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026LV-ROVER-MLT: Low-Resource Maltese OCR by Synthetic Fine-Tuning and Multi-Stream Arbitration30 Jun 2026
- 2026TextDS: Parameter-Efficient Representation Alignment for Scene Text Detection under Distribution Shifts26 Jun 2026
- 2026Advancing WordArt-Oriented Scene Text Recognition: Datasets and Methods23 Jun 2026
- 2026Koshur Pixel: a large-scale synthetic ocr dataset for kashmiri22 Jun 2026
- 2026Training-Free Metrics for Synthetic Object Detection Data: A Proxy for Detector Performance18 Jun 2026
- 2026The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models5 Jun 2026
- 2026Zamba2-VL Technical Report29 May 2026
- 2026Comparative Evaluation of Machine Translation Systems on Images with Text28 May 2026
- 2026Do You Need Text Rectification? Soft Attention Mask Embedding for Rectification-Free Scene Text Spotting18 May 2026
- 2026StyleText: A Large-Scale Dataset and Benchmark for Stylized Scene Text Inpainting17 May 2026
- 2026ZAYA1-VL-8B Technical Report8 May 2026
- 2026POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation27 Apr 2026
- 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts14 Apr 2026
- 2026Batch Loss Score for Dynamic Data Pruning6 Apr 2026
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2026WebPII: Benchmarking Visual PII Detection for Computer-Use Agents18 Mar 2026
- 2026FontUse: A Data-Centric Approach to Style- and Use-Case-Conditioned In-Image Typography6 Mar 2026
- 2026What Is Wrong with Synthetic Data for Scene Text Recognition? A Strong Synthetic Engine with Diverse Simulations and Self-Evolution6 Feb 2026
- 2026Text-Pass Filter: An Efficient Scene Text Detector26 Jan 2026
- 2026synthocr-gen: A synthetic ocr dataset generator for low-resource languages- breaking the data barrier22 Jan 2026
- 2026600k-ks-ocr: a large-scale synthetic dataset for optical character recognition in kashmiri script3 Jan 2026
- 2025UniRec-0.1B: Unified Text and Formula Recognition with 0.1B Parameters24 Dec 2025
- 2025Digitizing Nepal's Written Heritage: A Comprehensive HTR Pipeline for Old Nepali Manuscripts18 Dec 2025
- 2025SELECT: Detecting Label Errors in Real-world Scene Text Data16 Dec 2025
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2025Global-Local Aware Scene Text Editing3 Dec 2025
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025Bharat Scene Text: A Novel Comprehensive Dataset and Benchmark for Indian Language Scene Text Understanding28 Nov 2025
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Text19 Nov 2025
- 2025TripleFDS: Triple Feature Disentanglement and Synthesis for Scene Text Editing17 Nov 2025
- 2025Advancements in synthetic data extraction for industrial injection molding11 Nov 2025
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulation28 Oct 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents17 Oct 2025
- 2025A Large-scale Dataset for Robust Complex Anime Scene Text Detection9 Oct 2025
50 newest of 396 All 396 (JSON)
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2021From Two to One: A New Scene Text Recognizer with Visual Language Modeling Networkcited by 97
- 2024Mini-InternVL: A Flexible-Transfer Pocket Multimodal Model with 5% Parameters and 90% Performancecited by 94
- 2025Scalable Vision Language Model Training via High Quality Data Curationcited by 54
- 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
- 2023CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Modelcited by 30
- 2022Language Matters: A Weakly Supervised Vision-Language Pre-training Approach for Scene Text Detection and Spottingcited by 27
- 2025Marten: Visual Question Answering with Mask Generation for Multi-modal Document Understandingcited by 20
- 2022Vision-Language Pre-Training for Boosting Scene Text Detectorscited by 18
- 2023CLIPTER: Looking at the Bigger Picture in Scene Text Recognitioncited by 16
- 2024Exploring the Capabilities of Large Multimodal Models on Dense Textcited by 14
12 most cited of 24 All 24 (JSON)
- 2026StepX-Edge: An On-Device UI Vision-Language Model via Architecture-Training-Deployment Co-Design20 Jul 2026
- 2026HunyuanOCR-1.5: Making Lightweight OCR VLMs Faster and Better6 Jul 2026
- 2026The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models5 Jun 2026
- 2026Zamba2-VL Technical Report29 May 2026
- 2026ZAYA1-VL-8B Technical Report8 May 2026
- 2026GlotOCR Bench: OCR Models Still Struggle Beyond a Handful of Unicode Scripts14 Apr 2026
- 2026PP-OCRv5: A Specialized 5M-Parameter Model Rivaling Billion-Parameter Vision-Language Models on OCR Tasks25 Mar 2026
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Text19 Nov 2025
- 2025GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs23 Oct 2025
- 2025Qianfan-VL: Domain-Enhanced Universal Vision-Language Models19 Sep 2025
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe16 Sep 2025
- 2025PsOCR: Benchmarking Large Multimodal Models for Optical Character Recognition in Low-resource Pashto Language15 May 2025
12 newest of 24 All 24 (JSON)
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Modelcited by 41
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blendingcited by 16
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Modelscited by 15
- 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generationcited by 13
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Modelscited by 8
- 2023DiffusionSTR: Diffusion Model for Scene Text Recognitioncited by 7
- 2023On Manipulating Scene Text in the Wild with Diffusion Modelscited by 6
- 2024Typographic Text Generation with Off-the-Shelf Diffusion Modelcited by 5
12 most cited of 17 All 17 (JSON)
- 2025MDiff4STR: Mask Diffusion Model for Scene Text Recognition1 Dec 2025
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulation28 Oct 2025
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun 2025
- 2025TextSR: Diffusion Super-Resolution with Multilingual OCR Guidance29 May 2025
- 2024First Creating Backgrounds Then Rendering Texts: A New Paradigm for Visual Text Blending14 Oct 2024
- 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation25 Mar 2024
- 2024Typographic Text Generation with Off-the-Shelf Diffusion Model22 Feb 2024
- 2024Text Image Inpainting via Global Structure-Guided Diffusion Models26 Jan 2024
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model19 Dec 2023
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec 2023
- 2023Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models28 Nov 2023
- 2023Scene Text Image Super-resolution based on Text-conditional Diffusion Models16 Nov 2023
12 newest of 17 All 17 (JSON)
- 2025TextMamba: Scene Text Detector with Mambacited by 2
- 2025TextMamba: Scene Text Detector with Mamba7 Dec 2025
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
- 2021OCR-free Document Understanding Transformercited by 400
- 2022Kubric: A scalable dataset generatorcited by 373
- 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
- 2021Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognitioncited by 194
- 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
- 2022Scene Text Recognition with Permuted Autoregressive Sequence Modelscited by 148
- 2023KOSMOS-2.5: A Multimodal Literate Modelcited by 95
- 2022Real-Time Scene Text Detection with Differentiable Binarization and Adaptive Scale Fusioncited by 94
- 2023REaLTabFormer: Generating Realistic Relational and Tabular Data using Transformerscited by 93
- 2022SVTR: Scene Text Recognition with a Single Visual Modelcited by 86
- 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
12 most cited of 350 All 350 (JSON)
- 2026PolyOCR-Venus: Unified OCR Foundation Models for Text-Centric Visual Intelligence29 Sep 2026
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation29 Sep 2026
- 2026Back-Tracking from Clarity: Self-Learning to See Text from Afar26 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026Confidence-Aware Ensemble and Long-Word Refinement for Artistic Text Recognition30 Aug 2026
- 2026Out-of-Length Scene Text Recognition: A Two-Axis Diagnosis and a Training-Free Fix25 Jul 2026
- 2026Persian Pixel: A large-scale synthetic OCR dataset for Persian language22 Jul 2026
- 20262D Rotary Position Embedding for Scene Text Recognition with Transformers15 Jul 2026
- 2026Metric-Guided Synthetic Image Data Rendering for Deep Learning compatible with Agentic AI14 Jul 2026
- 2026TextileNet: Towards Zero-shot Text-style Segmentation of Manuscripts10 Jul 2026
- 2026FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection9 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
12 newest of 350 All 350 (JSON)