mlsanityData to 14 Oct 2026

Quo Vadis Handwritten Text Generation for Handwritten Text Recognition?

arXiv 2508.09936 ↗First posted 13 Aug 2025cs.CV cs.DLcited by 2

Not on the map. Why?

Abstract (arXiv)

The digitization of historical manuscripts presents significant challenges for Handwritten Text Recognition (HTR) systems, particularly when dealing with small, author-specific collections that diverge from the training data distributions. Handwritten Text Generation (HTG) techniques, which generate synthetic data tailored to specific handwriting styles, offer a promising solution to address these challenges. However, the effectiveness of various HTG models in enhancing HTR performance, especially in low-resource transcription settings, has not been thoroughly evaluated. In this work, we systematically compare three state-of-the-art styled HTG models (representing the generative adversarial, diffusion, and autoregressive paradigms for HTG) to assess their impact on HTR fine-tuning. We analyze how visual and linguistic characteristics of synthetic data influence fine-tuning outcomes and provide quantitative guidelines for selecting the most effective HTG model. The results of our analysis provide insights into the current capabilities of HTG methods and highlight key areas for further improvement in their application to low-resource HTR.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 71 references that are in the map. First posted on arXiv 13 Aug 2025.

Builds on

48 of 71 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Conditional Generative Adversarial Netscited by 2,162
  5. 2017Deformable Convolutional Networkscited by 1,488
  6. 2018Demystifying MMD GANscited by 1,293
  7. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  8. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
  9. 2021CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representationcited by 232
  10. 2020Pay Attention to What You Read: Non-recurrent Handwritten Text-Line Recognitioncited by 71
  11. 2020ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generationcited by 69
  12. 2020GANwriting: Content-Conditioned Generation of Styled Handwritten Word Imagescited by 68
36 more
  1. 2023Conditional Text Image Generation with Diffusion Modelscited by 58
  2. 2020OrigamiNet: Weakly-Supervised, Segmentation-Free, One-Step, Full Page Text Recognition by learning to unfoldcited by 53
  3. 2021TextStyleBrush: Transfer of Text Aesthetics from a Single Examplecited by 49
  4. 2016Joint Line Segmentation and Transcription for End-to-End Handwritten Paragraph Recognitioncited by 46
  5. 2016Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attentioncited by 45
  6. 2013Dropout improves Recurrent Neural Networks for Handwriting Recognitioncited by 39
  7. 2021Handwriting Transformerscited by 37
  8. 2022Content and Style Aware Generation of Text-line Images for Handwriting Recognitioncited by 35
  9. 2018Handwriting Recognition in Low-resource Scripts using Adversarial Learningcited by 32
  10. 2023Handwritten Text Generation from Visual Archetypescited by 32
  11. 2020Recurrence-free unconstrained handwritten text recognition using gated fully convolutional networkcited by 23
  12. 2023WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Modelscited by 23
  13. 2022A Survey of Historical Document Image Datasetscited by 20
  14. 2024Alfie: Democratising RGBA Image Generation With No cited by 20
  15. 2020Boosting offline handwritten text recognition in historical documents with few labeled linescited by 19
  16. 2023HWD: A Novel Evaluation Score for Styled Handwritten Text Generationcited by 19
  17. 2021Rescoring Sequence-to-Sequence Models for Text Line Recognition with CTC-Prefixescited by 18
  18. 2024VATr++: Choose Your Words Wisely for Handwritten Text Generationcited by 18
  19. 2022The LAM Dataset: A Novel Benchmark for Line-Level Handwritten Text Recognitioncited by 17
  20. 2024Best Practices for a Handwritten Text Recognition Systemcited by 17
  21. 2024DiffusionPen: Towards Controlling the Style of Handwritten Text Generationcited by 16
  22. 2022Boosting Modern and Historical Handwritten Text Recognition with Deformable Convolutionscited by 14
  23. 2019KuroNet: Pre-Modern Japanese Kuzushiji Character Recognition with Deep Learningcited by 13
  24. 2023How to Choose Pretrained Handwriting Recognition Models for Single Writer Fine-Tuningcited by 13
  25. 2025Zero-Shot Styled Text Image Generation, but Make It Autoregressivecited by 13
  26. 2018Handwriting Recognition of Historical Documents with few labeled datacited by 10
  27. 2019Fully Convolutional Networks for Handwriting Recognitioncited by 10
  28. 2024Merging and Splitting Diffusion Paths for Semantically Coherent Panoramascited by 9
  29. 2018Boosting Handwriting Text Recognition in Small Databases with Transfer Learningcited by 8
  30. 2023Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Modelcited by 8
  31. 2023Evaluating Synthetic Pre-Training for Handwriting Processing Taskscited by 7
  32. 2024μgat: Improving Single-Page Document Parsing by Providing Multi-Page Contextcited by 7
  33. 2021One-shot Compositional Data Generation for Low Resource Handwritten Text Recognitioncited by 6
  34. 2024Rethinking HTG Evaluation: Bridging Generation and Recognitioncited by 6
  35. 2024Binarizing Documents by Leveraging both Space and Frequencycited by 3
  36. 2023Volumetric Fast Fourier Convolution for Detecting Ink on the Carbonized Herculaneum Papyricited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.