mlsanityData to 7 Oct 2026

Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer

arXiv 2605.27487 ↗First posted 26 May 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Handwritten text generation (HTG) conditioned on writer style has been widely studied for Latin scripts, but remains underexplored for low-resource and non-Latin writing systems, leaving open how well existing models generalise beyond the Latin domain. Cyrillic, particularly Ukrainian, lacks both large-scale writer-labeled datasets and empirical evidence of such generalisation. To address this gap, we construct a Ukrainian handwritten word dataset of 126,177 images from 308 writers using connected-component segmentation, quality filtering, and targeted oversampling of underrepresented Ukrainian characters. We retrain DiffusionPen, a MobileNetV2 triplet-loss style encoder with a CANINE-conditioned latent diffusion U-Net, on this dataset without architectural modification, testing direct transfer from Latin to Cyrillic. We evaluate cross-domain style transfer in three settings: cross-lingual transfer from IAM English samples, zero-shot transfer to an early 20th-century Ukrainian manuscript, and few-shot imitation of contemporary writers. The model produces legible, style-consistent word images, indicating that few-shot latent diffusion models generalize beyond the Latin-script domain. We release the dataset, trained models, and evaluation protocol as a reproducible benchmark for writer-aware Cyrillic HTG, providing a foundation for extending stylized HTG to other underrepresented writing systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 22 of its 34 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

22 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024DiffusionPen: Towards Controlling the Style of Handwritten Text Generation9 Sep
  2. 2024StylusAI: Stylistic Adaptation for Robust German Handwritten Text Generation22 Jul
  3. 2024VATr++: Choose Your Words Wisely for Handwritten Text Generation16 Feb
  4. 2023WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Models29 Mar

Other references · 18

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  8. 2022Simple Baselines for Image Restorationcited by 701
  9. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 278
  10. 2019Character Region Awareness for Text Detectioncited by 273
  11. 2021CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representationcited by 229
  12. 2020ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generationcited by 69
6 more
  1. 2020GANwriting: Content-Conditioned Generation of Styled Handwritten Word Imagescited by 68
  2. 2019Adversarial Generation of Handwritten Text Images Conditioned on Sequencescited by 37
  3. 2021Handwriting Transformerscited by 37
  4. 2023Handwritten Text Generation from Visual Archetypescited by 32
  5. 2025Beyond Isolated Words: Diffusion Brush for Handwritten Text-Line Generationcited by 10
  6. 2025Dual Orthogonal Guidance for Robust Diffusion-based Handwritten Text Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Semi-Supervised Adaptation of Diffusion Models for Handwritten Text Generation
  2. 2023Fine-grained Text Style Transfer with Diffusion-Based Language Models
  3. 2025DiffInk: Glyph- and Style-Aware Latent Diffusion Transformer for Text to Online Handwriting Generation
  4. 2024Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Models
  5. 2020Diffusion models for Handwriting Generation
  6. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
  7. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models
  8. 2023XDLM: Cross-lingual Diffusion Language Model for Machine Translation