mlsanityData to 14 Oct 2026

InkDiffuser: High-Fidelity One-shot Chinese Calligraphy via Differentiable Morphological Optimization

arXiv 2605.05865 ↗First posted 7 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Current Chinese calligraphy generation methods suffer from poor stroke rendering and unrealistic ink morphology, resulting in outputs with limited visual fidelity and artistic fluidity. To address this problem, we propose InkDiffuser, a diffusion-based generative framework for one-shot Chinese calligraphy synthesis. To guarantee high-fidelity rendering, we introduce two core contributions: a high-frequency enhancement mechanism and a Differentiable Ink Structure (DIS) loss that explicitly regularizes ink morphology. Inspired by the observation that high-frequency information in individual samples typically carries contour details, we enhance content extraction by explicitly fusing high-frequency representations for more accurate font structure. Furthermore, we propose a differentiable ink structure loss that integrates differentiable morphological operations into the diffusion process. By allowing the model to learn an explicit decomposition of ink-trace structures, DIS facilitates fine-grained refinement of stroke contours and delivers significantly improved visual realism in the generated calligraphy. Extensive experiments on various calligraphic styles and complex characters demonstrate that InkDiffuser can generate superior calligraphy fonts with realistic ink rendering effects from only a single reference glyph and outperform existing few-shot font generation approaches in structural consistency, detail fidelity, and visual authenticity. The code is available at the following address: https://github.com/JingVIPLab/InkDiffuser.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 44 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

33 of 44 references.

References · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  8. 2018On the Spectral Bias of Neural Networkscited by 1,341
  9. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
  10. 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
  11. 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
  12. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
21 more
  1. 2021DG-Font: Deformable Generative Networks for Unsupervised Font Generationcited by 70
  2. 2017Separating Style and Content for Generalized Style Transfercited by 64
  3. 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
  4. 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
  5. 2020Few-shot Font Generation with Localized Style Representations and Factorizationcited by 47
  6. 2020Few-shot Compositional Font Generation with Dual Memorycited by 44
  7. 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generationcited by 40
  8. 2022Few-Shot Font Generation by Learning Fine-Grained Local Stylescited by 34
  9. 2017Learning to Write Stylized Chinese Characters by Reading a Handful of Examplescited by 28
  10. 2020CalliGAN: Style and Structure-aware Chinese Calligraphy Character Generatorcited by 28
  11. 2023CF-Font: Content Fusion for Few-shot Font Generationcited by 26
  12. 2018TET-GAN: Text Effects Transfer via Stylization and Destylizationcited by 19
  13. 2022XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generationcited by 18
  14. 2023Calliffusion: Chinese Calligraphy Generation and Style Transfer with Diffusion Modelingcited by 9
  15. 2019Handwritten Chinese Font Generation with Collaborative Stroke Refinementcited by 8
  16. 2023Few shot font generation via transferring similarity guided global style and quantization local stylecited by 8
  17. 2022HGAN: Hierarchical Graph Alignment Network for Image-Text Retrievalcited by 6
  18. 2023VQ-Font: Few-Shot Font Generation with Structure-Aware Enhancement and Quantizationcited by 5
  19. 2023Few-shot Font Generation by Learning Style Difference and Similaritycited by 4
  20. 2023DeepCalliFont: Few-shot Chinese Calligraphy Font Synthesis by Integrating Dual-modality Generative Modelscited by 4
  21. 2025MX-Font++: Mixture of Heterogeneous Aggregation Experts for Few-shot Font Generationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Moyun: A Diffusion-Based Model for Style-Specific Chinese Calligraphy Generation
  2. 2026CalliMaster: Mastering Page-level Chinese Calligraphy via Layout-guided Spatial Planning
  3. 2026Structure-Level Disentangled Diffusion for Few-Shot Chinese Font Generation
  4. 2024Few-shot Calligraphy Style Learning
  5. 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution
  6. 2025Calligrapher: Freestyle Text Image Customization
  7. 2023CalliPaint: Chinese Calligraphy Inpainting with Diffusion Model
  8. 2024DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation