mlsanityData to 7 Oct 2026

DISGO: Automatic End-to-End Evaluation for Scene Text OCR

arXiv 2308.13173 ↗First posted 25 Aug 2023cs.CV cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper discusses the challenges of optical character recognition (OCR) on natural scenes, which is harder than OCR on documents due to the wild content and various image backgrounds. We propose to uniformly use word error rates (WER) as a new measurement for evaluating scene-text OCR, both end-to-end (e2e) performance and individual system component performances. Particularly for the e2e metric, we name it DISGO WER as it considers Deletion, Insertion, Substitution, and Grouping/Ordering errors. Finally we propose to utilize the concept of super blocks to automatically compute BLEU scores for e2e OCR machine translation. The small SCUT public test set is used to demonstrate WER performance by a modularized OCR system.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 25 Aug 2023.

Builds on

18 of 23 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  5. 2018Panoptic Segmentationcited by 796
  6. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  7. 2021TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene textcited by 170
  8. 2020FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel Dimensionscited by 152
  9. 2020Mask TextSpotter v3: Segmentation Proposal Network for Robust Scene Text Spottingcited by 114
  10. 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 96
  11. 2021ABCNet v2: Adaptive Bezier-Curve Network for Real-time End-to-end Text Spottingcited by 84
  12. 2017Detecting Curve Text in the Wild: New Dataset and New Solutioncited by 82
6 more
  1. 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
  2. 2021Open Images V5 Text Annotation and Yet Another Mask Text Spottercited by 46
  3. 2020FBNetV3: Joint Architecture-Recipe Search using Predictor Pretrainingcited by 35
  4. 2022GLASS: Global to Local Attention for Scene-Text Spottingcited by 34
  5. 2017DeepPermNet: Visual Permutation Learningcited by 32
  6. 2022Contextual Text Block Detection towards Scene Text Understandingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.

  1. 2024Lumos : Empowering Multimodal LLMs with Scene Text Recognitioncited by 8
  2. 2024Computer Vision Intelligence Test Modeling and Generation: A Case Study on Smart OCRcited by 2
  3. 2025MindVL: Towards Efficient and Effective Training of Multimodal Large Language Models on Ascend NPUscited by 2
  4. 2026The Character Error Vector: Decomposable errors for page-level OCR evaluationcited by 1