mlsanityData to 7 Oct 2026

Full Page Handwriting Recognition via Image to Sequence Extraction

arXiv 2103.06450 ↗First posted 11 Mar 2021cs.CV cs.AI cs.CLcited by 24

Not on the map. Why?

Abstract (arXiv)

We present a Neural Network based Handwritten Text Recognition (HTR) model architecture that can be trained to recognize full pages of handwritten or printed text without image segmentation. Being based on Image to Sequence architecture, it can extract text present in an image and then sequence it correctly without imposing any constraints regarding orientation, layout and size of text and non-text. Further, it can also be trained to generate auxiliary markup related to formatting, layout and content. We use character level vocabulary, thereby enabling language and terminology of any subject. The model achieves a new state-of-art in paragraph level recognition on the IAM dataset. When evaluated on scans of real world handwritten free form test answers - beset with curved and slanted lines, drawings, tables, math, chemistry and other symbols - it performs better than all commercially available HTR cloud APIs. It is deployed in production as part of a commercial web application.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 11 Mar 2021.

Builds on

19 of 33 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  5. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2016Pointer Sentinel Mixture Modelscited by 2,992
  9. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  10. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  11. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  12. 2019Decoupled Attention Network for Text Recognitioncited by 102
7 more
  1. 2018Tensor2Tensor for Neural Machine Translationcited by 85
  2. 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
  3. 2020Pay Attention to What You Read: Non-recurrent Handwritten Text-Line Recognitioncited by 71
  4. 2016Joint Line Segmentation and Transcription for End-to-End Handwritten Paragraph Recognitioncited by 46
  5. 2016Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attentioncited by 45
  6. 2013Dropout improves Recurrent Neural Networks for Handwriting Recognitioncited by 39
  7. 2018Teaching Machines to Code: Neural Markup Generation with Visual Attentioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 7; 2024: 6; 2025: 7; 2026: 1.

24 papers.

Sort:

By area:

  1. 2022DAN: a Segmentation-free Document Attention Network for Handwritten Document Recognitioncited by 62
  2. 2024Sheet Music Transformer: End-To-End Optical Music Recognition Beyond Monophonic Transcriptioncited by 20
  3. 2024End-to-End Full-Page Optical Music Recognition for Pianoform Sheet Musiccited by 13
  4. 2025Handwritten Text Recognition: A Surveycited by 12
  5. 2025Benchmarking Large Language Models for Handwritten Text Recognitioncited by 11
  6. 2023Faster DAN: Multi-target Queries with Document Positional Encoding for End-to-end Handwritten Document Recognitioncited by 9
  7. 2024DANIEL: A fast Document Attention Network for Information Extraction and Labelling of handwritten documentscited by 9
  8. 2023End-to-End Page-Level Assessment of Handwritten Text Recognitioncited by 8
  9. 2024Text Image Inpainting via Global Structure-Guided Diffusion Modelscited by 8
  10. 2023MSdocTr-Lite: A Lite Transformer for Full Page Multi-script Handwriting Recognitioncited by 7
  11. 2022Auxiliary Cross-Modal Representation Learning with Triplet Loss Functions for Online Handwriting Recognitioncited by 6
  12. 2024Self-Supervised Learning for Text Recognition: A Critical Surveycited by 3
12 more
  1. 2025DocTTT: Test-Time Training for Handwritten Document Recognition Using Meta-Auxiliary Learningcited by 3
  2. 2025Meta-DAN: towards an efficient prediction strategy for page-level handwritten text recognitioncited by 3
  3. 2025Normalized vs Diplomatic Annotation: A Case Study of Automatic Information Extraction from Handwritten Uruguayan Birth Certificatescited by 3
  4. 2023From Robots to Books: An Introduction to Smart Applications of AI in Education (AIEd)cited by 2
  5. 2023Writer adaptation for offline text recognition: An exploration of neural network-based methodscited by 2
  6. 2023IDPL-PFOD2: A New Large-Scale Dataset for Printed Farsi Optical Character Recognitioncited by 1
  7. 2025RVAFM: Re-parameterizing Vertical Attention Fusion Module for Handwritten Paragraph Text Recognitioncited by 1
  8. 2025The OCR Quest for Generalization: Learning to recognize low-resource alphabets with model editingcited by 1
  9. 2026Transcoda: End-to-End Zero-Shot Optical Music Recognition via Data-Centric Synthetic Trainingcited by 1
  10. 2022Proceedings of the 4th International Workshop on Reading Music Systemscited by 0
  11. 2023Proceedings of the 5th International Workshop on Reading Music Systemscited by 0
  12. 2024Classification of Non-native Handwritten Characters Using Convolutional Neural Networkcited by 0