Diffusion models for Handwriting Generation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
In this paper, we propose a diffusion probabilistic model for handwriting generation. Diffusion models are a class of generative models where samples start from Gaussian noise and are gradually denoised to produce output. Our method of handwriting generation does not require using any text-recognition based, writer-style based, or adversarial loss functions, nor does it require training of auxiliary networks. Our model is able to incorporate writer stylistic features directly from image data, eliminating the need for user interaction during sampling. Experiments reveal that our model is able to generate realistic , high quality images of handwritten text in a similar style to a given writer. Our implementation can be found at https://github.com/tcl9876/Diffusion-Handwriting-Generation
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 25 of its 32 references that are in the map. First posted on arXiv 13 Nov 2020.
Builds on
25 of 32 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2016Layer Normalizationcited by 5,579
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2013Generating Sequences With Recurrent Neural Networkscited by 549
13 more
- 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2016A Kernelized Stein Discrepancy for Goodness-of-fit Tests and Model Evaluationcited by 236
- 2020Adversarial score matching and improved sampling for image generationcited by 95
- 2020ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generationcited by 69
- 2020GANwriting: Content-Conditioned Generation of Styled Handwritten Word Imagescited by 68
- 2018Geometry Score: A Method For Comparing Generative Adversarial Networkscited by 56
- 2020Efficient Learning of Generative Models via Finite-Difference Score Matchingcited by 49
- 2018DeepWriting: Making Digital Ink Editable via Deep Generative Modelingcited by 39
- 2019Adversarial Generation of Handwritten Text Images Conditioned on Sequencescited by 37
- 2020Generating Handwriting via Decoupled Style Descriptorscited by 23
- 2020Fast Mixing of Multi-Scale Langevin Dynamics under the Manifold Hypothesiscited by 11
- 2020Spatio-Temporal Handwriting Imitationcited by 5
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 8; 2024: 9; 2025: 2; 2026: 3.
25 papers.
Sort:
By area:
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Imagescited by 74
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2024Visual Text Generation in the Wildcited by 22
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generationcited by 20
- 2024VATr++: Choose Your Words Wisely for Handwritten Text Generationcited by 18
- 2023ChiroDiff: Modelling chirographic data with Diffusion Modelscited by 14
- 2023Zero-shot Generation of Training Data with Denoising Diffusion Probabilistic Model for Handwritten Chinese Character Recognitioncited by 10
- 2023DiffSketching: Sketch Control Image Synthesis with Diffusion Modelscited by 10
- 2023Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Modelcited by 8
13 more
- 2024Freehand Sketch Generation from Mechanical Componentscited by 8
- 2024Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Modelscited by 5
- 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolutioncited by 5
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
- 2025Autoregressive Styled Text Image Generation, but Make it Reliablecited by 3
- 2024StylusAI: Stylistic Adaptation for Robust German Handwritten Text Generationcited by 2
- 2024Latent Diffusion for Guided Document Table Generationcited by 2
- 2024Semi-Supervised Adaptation of Diffusion Models for Handwritten Text Generationcited by 2
- 2023Conditional Human Sketch Synthesis with Explicit Abstraction Controlcited by 1
- 2023Sampling and Ranking for Digital Ink Generation on a tight computational budgetcited by 0
- 2025Layout Stroke Imitation: A Layout Guided Handwriting Stroke Generation for Style Imitation with Diffusion Modelcited by 0
- 2026Telling Human and Machine Handwriting Apartcited by 0
- 2026HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Spacecited by 0
- 2026HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space17 Jun 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2026Telling Human and Machine Handwriting Apart16 Jan 2026
- 2025Autoregressive Styled Text Image Generation, but Make it Reliable27 Oct 2025
- 2025Layout Stroke Imitation: A Layout Guided Handwriting Stroke Generation for Style Imitation with Diffusion Model19 Sep 2025
- 2024Semi-Supervised Adaptation of Diffusion Models for Handwritten Text Generation20 Dec 2024
- 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution9 Oct 2024
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generation6 Sep 2024
- 2024Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Models1 Sep 2024
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2024Freehand Sketch Generation from Mechanical Components12 Aug 2024
- 2024StylusAI: Stylistic Adaptation for Robust German Handwritten Text Generation22 Jul 2024
13 more
- 2024Visual Text Generation in the Wild19 Jul 2024
- 2024VATr++: Choose Your Words Wisely for Handwritten Text Generation16 Feb 2024
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning19 Dec 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023Conditional Human Sketch Synthesis with Explicit Abstraction Control15 Jun 2023
- 2023Sampling and Ranking for Digital Ink Generation on a tight computational budget2 Jun 2023
- 2023Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Model31 May 2023
- 2023DiffSketching: Sketch Control Image Synthesis with Diffusion Models30 May 2023
- 2023Zero-shot Generation of Training Data with Denoising Diffusion Probabilistic Model for Handwritten Chinese Character Recognition25 May 2023
- 2023ChiroDiff: Modelling chirographic data with Diffusion Models7 Apr 2023
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images27 Sep 2022
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun 2021
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speech13 May 2021
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Imagescited by 74
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2024VATr++: Choose Your Words Wisely for Handwritten Text Generationcited by 18
- 2023ChiroDiff: Modelling chirographic data with Diffusion Modelscited by 14
- 2023Zero-shot Generation of Training Data with Denoising Diffusion Probabilistic Model for Handwritten Chinese Character Recognitioncited by 10
- 2023DiffSketching: Sketch Control Image Synthesis with Diffusion Modelscited by 10
- 2023Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Modelcited by 8
- 2024Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Modelscited by 5
- 2024StylusAI: Stylistic Adaptation for Robust German Handwritten Text Generationcited by 2
12 most cited of 15 All 15 (JSON)
- 2025Layout Stroke Imitation: A Layout Guided Handwriting Stroke Generation for Style Imitation with Diffusion Model19 Sep 2025
- 2024Semi-Supervised Adaptation of Diffusion Models for Handwritten Text Generation20 Dec 2024
- 2024Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Models1 Sep 2024
- 2024Latent Diffusion for Guided Document Table Generation19 Aug 2024
- 2024StylusAI: Stylistic Adaptation for Robust German Handwritten Text Generation22 Jul 2024
- 2024VATr++: Choose Your Words Wisely for Handwritten Text Generation16 Feb 2024
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learning19 Dec 2023
- 2023Conditional Text Image Generation with Diffusion Models19 Jun 2023
- 2023Improving Handwritten OCR with Training Samples Generated by Glyph Conditional Denoising Diffusion Probabilistic Model31 May 2023
- 2023DiffSketching: Sketch Control Image Synthesis with Diffusion Models30 May 2023
- 2023Zero-shot Generation of Training Data with Denoising Diffusion Probabilistic Model for Handwritten Chinese Character Recognition25 May 2023
- 2023ChiroDiff: Modelling chirographic data with Diffusion Models7 Apr 2023
12 newest of 15 All 15 (JSON)
- 2024Visual Text Generation in the Wildcited by 22
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generationcited by 20
- 2024Freehand Sketch Generation from Mechanical Componentscited by 8
- 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolutioncited by 5
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligencecited by 4
- 2025Autoregressive Styled Text Image Generation, but Make it Reliablecited by 3
- 2023Conditional Human Sketch Synthesis with Explicit Abstraction Controlcited by 1
- 2023Sampling and Ranking for Digital Ink Generation on a tight computational budgetcited by 0
- 2026Telling Human and Machine Handwriting Apartcited by 0
- 2026HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Spacecited by 0
- 2026HandwritingAgent: Language-Driven Handwriting Synthesis in Scalable Vector Space17 Jun 2026
- 2026Beyond Human Annotation: Recent Advances in Data Generation Methods for Document Intelligence18 Jan 2026
- 2026Telling Human and Machine Handwriting Apart16 Jan 2026
- 2025Autoregressive Styled Text Image Generation, but Make it Reliable27 Oct 2025
- 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution9 Oct 2024
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generation6 Sep 2024
- 2024Freehand Sketch Generation from Mechanical Components12 Aug 2024
- 2024Visual Text Generation in the Wild19 Jul 2024
- 2023Conditional Human Sketch Synthesis with Explicit Abstraction Control15 Jun 2023
- 2023Sampling and Ranking for Digital Ink Generation on a tight computational budget2 Jun 2023
Similar, not cited
Close in wording, no citation either way
- 2023WordStylist: Styled Verbatim Handwritten Text Generation with Latent Diffusion Models
- 2024DiffusionPen: Towards Controlling the Style of Handwritten Text Generation
- 2026CONSTANT: Towards High-Quality One-Shot Handwriting Generation with Patch Contrastive Enhancement and Style-Aware Quantization
- 2025DiffInk: Glyph- and Style-Aware Latent Diffusion Transformer for Text to Online Handwriting Generation
- 2025Dual Orthogonal Guidance for Robust Diffusion-based Handwritten Text Generation
- 2024Generative Modeling with Diffusion
- 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
- 2023Calliffusion: Chinese Calligraphy Generation and Style Transfer with Diffusion Modeling