mlsanityData to 14 Oct 2026

TextPixs: Glyph-Conditioned Diffusion with Character-Aware Attention and OCR-Guided Supervision

arXiv 2507.06033 ↗First posted 8 Jul 2025cs.CV cs.AI cs.LGcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

The modern text-to-image diffusion models boom has opened a new era in digital content production as it has proven the previously unseen ability to produce photorealistic and stylistically diverse imagery based on the semantics of natural-language descriptions. However, the consistent disadvantage of these models is that they cannot generate readable, meaningful, and correctly spelled text in generated images, which significantly limits the use of practical purposes like advertising, learning, and creative design. This paper introduces a new framework, namely Glyph-Conditioned Diffusion with Character-Aware Attention (GCDA), using which a typical diffusion backbone is extended by three well-designed modules. To begin with, the model has a dual-stream text encoder that encodes both semantic contextual information and explicit glyph representations, resulting in a character-aware representation of the input text that is rich in nature. Second, an attention mechanism that is aware of the character is proposed with a new attention segregation loss that aims to limit the attention distribution of each character independently in order to avoid distortion artifacts. Lastly, GCDA has an OCR-in-the-loop fine-tuning phase, where a full text perceptual loss, directly optimises models to be legible and accurately spell. Large scale experiments to benchmark datasets, such as MARIO-10M and T2I-CompBench, reveal that GCDA sets a new state-of-the-art on all metrics, with better character based metrics on text rendering (Character Error Rate: 0.08 vs 0.21 for the previous best; Word Error Rate: 0.15 vs 0.25), human perception, and comparable image synthesis quality on high-fidelity (FID: 14.3).

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

35 of 40 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025TextInVision: Text and Prompt Complexity Driven Visual Text Generation Benchmark17 Mar
  2. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
  3. 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
  4. 2023Improving Compositional Text-to-image Generation with Large Vision-Language Models10 Oct
  5. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis26 Jun
  6. 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
  7. 2023TextDiffuser: Diffusion Models as Text Painters18 May
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2020Denoising Diffusion Implicit Modelscited by 9,781
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2016Improved Techniques for Training GANscited by 2,970
  11. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  12. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
13 more
  1. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  2. 2015Spatial Transformer Networkscited by 1,429
  3. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  4. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  5. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  6. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
  7. 2021TrOCR: Transformer-based Optical Character Recognition with Pre-trained Modelscited by 279
  8. 2019Character Region Awareness for Text Detectioncited by 278
  9. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
  10. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 179
  11. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  12. 2022OCR-VQGAN: Taming Text-within-Image Generationcited by 31
  13. 2023A Prompt Log Analysis of Text-to-Image Generation Systemscited by 24

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
  2. 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation
  3. 2024Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training
  4. 2023GlyphDiffusion: Text Generation as Image Generation
  5. 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection
  6. 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning
  7. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models
  8. 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis