mlsanityData to 7 Oct 2026

WordCraft: Interactive Artistic Typography with Attention Awareness and Noise Blending

arXiv 2507.09573 ↗First posted 13 Jul 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Artistic typography aims to stylize input characters with visual effects that are both creative and legible. Traditional approaches rely heavily on manual design, while recent generative models, particularly diffusion-based methods, have enabled automated character stylization. However, existing solutions remain limited in interactivity, lacking support for localized edits, iterative refinement, multi-character composition, and open-ended prompt interpretation. We introduce WordCraft, an interactive artistic typography system that integrates diffusion models to address these limitations. WordCraft features a training-free regional attention mechanism for precise, multi-region generation and a noise blending that supports continuous refinement without compromising visual quality. To support flexible, intent-driven generation, we incorporate a large language model to parse and structure both concrete and abstract user prompts. These components allow our framework to synthesize high-quality, stylized typography across single- and multi-character inputs across multiple languages, supporting diverse user-centered workflows. Our system significantly enhances interactivity in artistic typography synthesis, opening up creative possibilities for artists and designers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 13 Jul 2025.

Builds on

33 of 42 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  11. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  12. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
21 more
  1. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  2. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
  3. 2023Using an LLM to Help With Code Understandingcited by 222
  4. 2017Neural Style Transfer: A Reviewcited by 199
  5. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
  6. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  7. 2017Multi-Content GAN for Few-Shot Font Style Transfercited by 100
  8. 2023LooseControl: Lifting ControlNet for Generalized Depth Conditioningcited by 68
  9. 2023Word-As-Image for Semantic Typographycited by 62
  10. 2019Controllable Artistic Text Style Transfer via Shape-Matching GANcited by 45
  11. 2020Multi-modal Attention for Speech Emotion Recognitioncited by 29
  12. 2023DS-Fusion: Artistic Typography via Discriminated and Stylized Diffusioncited by 26
  13. 2024SmartControl: Enhancing ControlNet for Handling Rough Visual Conditionscited by 24
  14. 2023HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusioncited by 23
  15. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLMcited by 20
  16. 2018TET-GAN: Text Effects Transfer via Stylization and Destylizationcited by 19
  17. 2023WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Modelscited by 15
  18. 2023Local Conditional Controlling for Text-to-Image Diffusion Modelscited by 13
  19. 2024FontStudio: Shape-Adaptive Diffusion Model for Coherent and Consistent Font Effect Generationcited by 9
  20. 2024MetaDesigner: Advancing Artistic Typography Through AI-Driven, User-Centric, and Multilingual WordArt Synthesiscited by 6
  21. 2024VitaGlyph: Vitalizing Artistic Typography with Flexible Dual-branch Diffusion Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FontUse: A Data-Centric Approach to Style- and Use-Case-Conditioned In-Image Typography
  2. 2024Khattat: Enhancing Readability and Concept Representation of Semantic Typography
  3. 2024Dynamic Typography: Bringing Text to Life via Video Diffusion Prior
  4. 2026LogoDiffuser: Training-Free Multilingual Logo Generation and Stylization via Letter-Aware Attention Control
  5. 2024Typographic Text Generation with Off-the-Shelf Diffusion Model
  6. 2025CompArt: Operationalizing Aesthetic Alignment in Text-to-Image Generation via Principles of Art
  7. 2024Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era
  8. 2026FontFusion: Enhancing Generative Text in Diffusion Models with Typographic Conditioning