mlsanityData to 7 Oct 2026

Word-As-Image for Semantic Typography

arXiv 2303.01818 ↗First posted 3 Mar 2023cs.CV cs.AI cs.GRcited by 62

Not on the map. Why?

Cited by 22 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

A word-as-image is a semantic typography technique where a word illustration presents a visualization of the meaning of the word, while also preserving its readability. We present a method to create word-as-image illustrations automatically. This task is highly challenging as it requires semantic understanding of the word and a creative idea of where and how to depict these semantics in a visually pleasing and legible manner. We rely on the remarkable ability of recent large pretrained language-vision models to distill textual concepts visually. We target simple, concise, black-and-white designs that convey the semantics clearly. We deliberately do not change the color or texture of the letters and do not use embellishments. Our method optimizes the outline of each letter to convey the desired concept, guided by a pretrained Stable Diffusion model. We incorporate additional loss terms to ensure the legibility of the text and the preservation of the style of the font. We show high quality and engaging results on numerous examples and compare to alternative techniques.

Key facts. Cited by 62 papers in the map (data through 7 Oct 2026). Builds on 36 of its 73 references that are in the map. First posted on arXiv 3 Mar 2023.

Builds on

36 of 73 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
24 more
  1. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  2. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  3. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  4. 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
  5. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  6. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
  7. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  9. 2017A Neural Representation of Sketch Drawingscited by 311
  10. 2021SegDiff: Image Segmentation with Diffusion Probabilistic Modelscited by 279
  11. 2021CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoderscited by 186
  12. 2022VectorFusion: Text-to-SVG by Abstracting Pixel-Based Diffusion Modelscited by 112
  13. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
  14. 2019A Learned Representation for Scalable Vector Graphicscited by 91
  15. 2022Towards Layer-wise Image Vectorizationcited by 77
  16. 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
  17. 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
  18. 2021Modern Evolution Strategies for Creativity: Fitting Concrete Images and Abstract Conceptscited by 40
  19. 2022Diffusion Guided Domain Adaptation of Image Generatorscited by 35
  20. 2016Awesome Typography: Statistics-Based Text Effects Transfercited by 24
  21. 2022Aesthetic Text Logo Synthesis via Content-aware Layout Inferringcited by 19
  22. 2021DeepVecFont: Synthesizing High-quality Vector Fonts via Dual-modality Learningcited by 14
  23. 2019Trick or TReAT: Thematic Reinforcement for Artistic Typographycited by 11
  24. 2020SketchPatch: Sketch Stylization via Seamless Patch-level Synthesiscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 17; 2024: 19; 2025: 12; 2026: 14.

62 papers.

Sort:

By area:

  1. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  2. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  3. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  4. 2023Noise-Free Score Distillationcited by 99
  5. 2023SVGDreamer: Text Guided SVG Generation with Diffusion Modelcited by 75
  6. 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
  7. 2023Breathing Life Into Sketches Using Text-to-Video Priorscited by 47
  8. 2023Posterior Distillation Samplingcited by 45
  9. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 39
  10. 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 36
  11. 2024PALP: Prompt Aligned Personalization of Text-to-Image Modelscited by 35
  12. 2024Text-to-Vector Generation with Neural Path Representationcited by 32
38 more
  1. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusioncited by 26
  2. 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 24
  3. 2023Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Modelcited by 21
  4. 2024AniClipart: Clipart Animation with Text-to-Video Priorscited by 17
  5. 2025NeuralSVG: An Implicit Representation for Text-to-Vector Generationcited by 16
  6. 2023WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Modelscited by 15
  7. 2024Dynamic Typography: Bringing Text to Life via Video Diffusion Priorcited by 12
  8. 2026Render-in-the-Loop: Vector Graphics Generation via Visual Self-Feedbackcited by 12
  9. 2025BannerAgency: Advertising Banner Design with Multimodal LLM Agentscited by 11
  10. 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideationcited by 10
  11. 2024TypeDance: Creating Semantic Typographic Logos from Image through Personalized Generationcited by 10
  12. 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generationcited by 9
  13. 2024Kinetic Typography Diffusion Modelcited by 9
  14. 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
  15. 2024FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applicationscited by 8
  16. 2025OracleFusion: Assisting the Decipherment of Oracle Bone Script with Structurally Constrained Semantic Typographycited by 8
  17. 2024MetaDesigner: Advancing Artistic Typography Through AI-Driven, User-Centric, and Multilingual WordArt Synthesiscited by 6
  18. 2025DuetSVG: Unified Multimodal SVG Generation with Internal Visual Guidancecited by 6
  19. 2026VAnim: Rendering-Aware Sparse State Modeling for Structure-Preserving Vector Animationcited by 6
  20. 2024Typographic Text Generation with Off-the-Shelf Diffusion Modelcited by 5
  21. 2025ViewCraft3D: High-Fidelity and View-Consistent 3D Vector Graphics Synthesiscited by 5
  22. 2026LottieGPT: Tokenizing Vector Animation for Autoregressive Generationcited by 5
  23. 2023Sketch Video Synthesiscited by 4
  24. 2024VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Modelscited by 4
  25. 2025RewardSDS: Aligning Score Distillation via Reward-Weighted Samplingcited by 4
  26. 2023Text-guided Image-and-Shape Editing and Generation: A Short Surveycited by 3
  27. 2024Font Style Interpolation with Diffusion Modelscited by 3
  28. 2024Vector Grimoire: Codebook-based Shape Generation under Raster Image Supervisioncited by 3
  29. 2024SD-πXL: Generating Low-Resolution Quantized Imagery via Score Distillationcited by 3
  30. 2025Neural Image Abstraction Using Long Smoothing B-Splinescited by 3
  31. 2026AmodalSVG: Amodal Image Vectorization via Semantic Layer Peelingcited by 3
  32. 2023AmbiGen: Generating Ambigrams from Pre-trained Diffusion Modelcited by 2
  33. 2025From Fragment to One Piece: A Survey on AI-Driven Graphic Designcited by 2
  34. 2025Style Customization of Text-to-Vector Generation with Image Diffusion Priorscited by 2
  35. 2025LINR Bridge: Vector Graphic Animation via Neural Implicits and Video Diffusion Priorscited by 2
  36. 2024Khattat: Enhancing Readability and Concept Representation of Semantic Typographycited by 1
  37. 2024SVGFusion: A VAE-Diffusion Transformer for Vector Graphic Generationcited by 1
  38. 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 1

50 most cited of 62 All 62 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Textured Word-As-Image illustration ↗
  2. 2026FontUse: A Data-Centric Approach to Style- and Use-Case-Conditioned In-Image Typography
  3. 2026Reading neq Seeing: Diagnosing and Closing the Typography Gap in Vision-Language Models
  4. 2024ABHINAW: A method for Automatic Evaluation of Typography within AI-Generated Images
  5. 2025Template-Based Text-to-Image Alignment for Language Accessibility: A Study on Visualizing Text Simplifications
  6. 2024JoyType: A Robust Design for Multilingual Visual Text Creation
  7. 2025Blending Concepts with Text-to-Image Diffusion Models
  8. 2024Type-R: Automatically Retouching Typos for Text-to-Image Generation