mlsanityData to 7 Oct 2026

DiffCJK: Conditional Diffusion Model for High-Quality and Wide-coverage CJK Character Generation

arXiv 2404.05212 ↗First posted 8 Apr 2024cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Chinese, Japanese, and Korean (CJK), with a vast number of native speakers, have profound influence on society and culture. The typesetting of CJK languages carries a wide range of requirements due to the complexity of their scripts and unique literary traditions. A critical aspect of this typesetting process is that CJK fonts need to provide a set of consistent-looking glyphs for approximately one hundred thousand characters. However, creating such a font is inherently labor-intensive and expensive, which significantly hampers the development of new CJK fonts for typesetting, historical, aesthetic, or artistic purposes. To bridge this gap, we are motivated by recent advancements in diffusion-based generative models and propose a novel diffusion method for generating glyphs in a targeted style from a single conditioned, standard glyph form. Our experiments show that our method is capable of generating fonts of both printed and hand-written styles, the latter of which presents a greater challenge. Moreover, our approach shows remarkable zero-shot generalization capabilities for non-CJK but Chinese-inspired scripts. We also show our method facilitates smooth style interpolation and generates bitmap images suitable for vectorization, which is crucial in the font creation process. In summary, our proposed method opens the door to high-quality, generative model-assisted font creation for CJK characters, for both typesetting and artistic endeavors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 17 of its 44 references that are in the map. First posted on arXiv 8 Apr 2024.

Builds on

17 of 44 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  7. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  8. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  9. 2022Diffusion Models in Vision: A Surveycited by 1,008
  10. 2020DDSP: Differentiable Digital Signal Processingcited by 177
  11. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generationcited by 113
  12. 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Modelscited by 71
4 more
  1. 2017Separating Style and Content for Generalized Style Transfercited by 64
  2. 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
  3. 2020Few-shot Font Generation with Localized Style Representations and Factorizationcited by 47
  4. 2022FontTransformer: Few-shot High-resolution Chinese Glyph Image Synthesis via Stacked Transformerscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Diff-Font: Diffusion Model for Robust One-Shot Font Generation
  2. 2024HFH-Font: Few-shot Chinese Font Synthesis with Higher Quality, Faster Speed, and Higher Resolution
  3. 2025Text-Conditioned Diffusion Model for High-Fidelity Korean Font Generation
  4. 2026Structure-Level Disentangled Diffusion for Few-Shot Chinese Font Generation
  5. 2024JoyType: A Robust Design for Multilingual Visual Text Creation
  6. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusion
  7. 2024Font Style Interpolation with Diffusion Models
  8. 2026FontFusion: Enhancing Generative Text in Diffusion Models with Typographic Conditioning