mlsanityData to 7 Oct 2026

Towards Diverse and Consistent Typography Generation

arXiv 2309.02099 ↗First posted 5 Sep 2023cs.CV cs.MMcited by 11

Not on the map. Why?

Abstract (arXiv)

In this work, we consider the typography generation task that aims at producing diverse typographic styling for the given graphic document. We formulate typography generation as a fine-grained attribute generation for multiple text elements and build an autoregressive model to generate diverse typography that matches the input design context. We further propose a simple yet effective sampling approach that respects the consistency and distinction principle of typography so that generated examples share consistent typographic styling across text elements. Our empirical study shows that our model successfully generates diverse typographic designs while preserving a consistent typographic structure.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 5 Sep 2023.

Builds on

38 of 54 references.

References · 38

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  8. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
  9. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 130
  10. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  11. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 122
  12. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
26 more
  1. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
  2. 2021CanvasVAE: Learning to Generate Vector Graphic Documentscited by 93
  3. 2022Character-Aware Models Improve Visual Text Renderingcited by 90
  4. 2021Variational Transformer Networks for Layout Generationcited by 88
  5. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  6. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  7. 2019Editing Text in the Wildcited by 81
  8. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  9. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  10. 2019Artistic Glyph Image Synthesis via One-Stage Few-Shot Learningcited by 53
  11. 2019READ: Recursive Autoencoders for Document Layout Generationcited by 51
  12. 2020SwapText: Image Based Texts Transfer in Scenescited by 49
  13. 2019STEFANN: Scene Text Editor using Font Adaptive Neural Networkcited by 46
  14. 2019Controllable Artistic Text Style Transfer via Shape-Matching GANcited by 45
  15. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
  16. 2022LayoutFormer++: Conditional Graphic Layout Generation via Constraint Serialization and Decoding Space Restrictioncited by 43
  17. 2023AutoPoster: A Highly Automatic and Content-aware Design System for Advertising Poster Generationcited by 41
  18. 2022Geometry Aligned Variational Transformer for Image-conditioned Layout Generationcited by 33
  19. 2016Awesome Typography: Statistics-Based Text Effects Transfercited by 24
  20. 2021De-rendering Stylized Textscited by 24
  21. 2018TET-GAN: Text Effects Transfer via Stylization and Destylizationcited by 19
  22. 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
  23. 2023TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Designcited by 18
  24. 2018Context-Aware Text-Based Binary Image Stylization and Synthesiscited by 11
  25. 2018Visual Font Pairingcited by 8
  26. 2021Font Style that Fits an Image -- Font Generation Based on Image Contextcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 6; 2025: 1; 2026: 2.

11 papers.

  1. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
  2. 2024OpenCOLE: Towards Reproducible Automatic Graphic Design Generationcited by 36
  3. 2023DEsignBench: Exploring and Benchmarking DALL-E 3 for Imagining Visual Designcited by 17
  4. 2024Multimodal Markup Document Models for Graphic Design Completioncited by 15
  5. 2024From Elements to Design: A Layered Approach for Automatic Graphic Design Compositioncited by 11
  6. 2024Kinetic Typography Diffusion Modelcited by 9
  7. 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
  8. 2024DocSynthv2: A Practical Autoregressive Modeling for Document Generationcited by 5
  9. 2025Step-by-step Layered Design Generationcited by 0
  10. 2026PRISM: Learning Design Knowledge from Data for Stylistic Design Improvementcited by 0
  11. 2026CPT: Controllable and Editable Design Variations with Language Modelscited by 0