mlsanityData to 14 Oct 2026

WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models

arXiv 2310.18332 ↗First posted 20 Oct 2023cs.CL cs.AI cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

This paper introduces WordArt Designer, a user-driven framework for artistic typography synthesis, relying on the Large Language Model (LLM). The system incorporates four key modules: the LLM Engine, SemTypo, StyTypo, and TexTypo modules. 1) The LLM Engine, empowered by the LLM (e.g., GPT-3.5), interprets user inputs and generates actionable prompts for the other modules, thereby transforming abstract concepts into tangible designs. 2) The SemTypo module optimizes font designs using semantic concepts, striking a balance between artistic transformation and readability. 3) Building on the semantic layout provided by the SemTypo module, the StyTypo module creates smooth, refined images. 4) The TexTypo module further enhances the design's aesthetics through texture rendering, enabling the generation of inventive textured fonts. Notably, WordArt Designer highlights the fusion of generative AI with artistic typography. Experience its capabilities on ModelScope: https://www.modelscope.cn/studios/WordArt/WordArt.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 27 of its 39 references that are in the map. First posted on arXiv 20 Oct 2023.

Builds on

27 of 39 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  12. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
15 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  5. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  6. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
  7. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  8. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
  9. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
  10. 2023Word-As-Image for Semantic Typographycited by 63
  11. 2017Multi-View Image Generation from a Single-Viewcited by 27
  12. 2018Video2Shop: Exact Matching Clothes in Videos to Online Shopping Imagescited by 26
  13. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusioncited by 26
  14. 2023ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rulescited by 24
  15. 2020Generating Person Images with Appearance-aware Pose Stylizercited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 10; 2025: 3; 2026: 1.

15 papers.

Sort:

By area:

  1. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  2. 2025POSTA: A Go-to Framework for Customized Artistic Poster Generationcited by 36
  3. 2024LLMs Meet Multimodal Generation and Editing: A Surveycited by 35
  4. 2025T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Modelscited by 10
  5. 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generationcited by 9
  6. 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
  7. 2024MetaDesigner: Advancing Artistic Typography Through AI-Driven, User-Centric, and Multilingual WordArt Synthesiscited by 6
  8. 2024Typographic Text Generation with Off-the-Shelf Diffusion Modelcited by 5
  9. 2024VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Modelscited by 4
  10. 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
  11. 2024WordArt Designer API: User-Driven Artistic Typography Synthesis with Large Language Models on ModelScopecited by 2
  12. 2024Khattat: Enhancing Readability and Concept Representation of Semantic Typographycited by 1
3 more
  1. 2026FontCrafter: High-Fidelity Element-Driven Artistic Font Creation with Visual In-Context Generationcited by 1
  2. 2024Cross-Domain Image Conversion by CycleDMcited by 0
  3. 2025WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blendingcited by 0