mlsanityData to 14 Oct 2026

TextGuider: Training-Free Guidance for Text Rendering via Attention Alignment

arXiv 2512.09350 ↗First posted 10 Dec 2025cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Despite recent advances, diffusion-based text-to-image models still struggle with accurate text rendering. Several studies have proposed fine-tuning or training-free refinement methods for accurate text rendering. However, the critical issue of text omission, where the desired text is partially or entirely missing, remains largely overlooked. In this work, we propose TextGuider, a novel training-free method that encourages accurate and complete text appearance by aligning textual content tokens and text regions in the image. Specifically, we analyze attention patterns in Multi-Modal Diffusion Transformer(MM-DiT) models, particularly for text-related tokens intended to be rendered in the image. Leveraging this observation, we apply latent guidance during the early stage of denoising steps based on two loss functions that we introduce. Our method achieves state-of-the-art performance in test-time text rendering, with significant gains in recall and strong results in OCR accuracy and CLIP score.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 45 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

38 of 45 references.

Closest ancestors · 13

Same direction, newest first

  1. 2024AMO Sampler: Enhancing Text Rendering with Overshooting28 Nov
  2. 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles20 Aug
  3. 2024Object-Conditioned Energy-Based Attention Map Alignment in Text-to-Image Diffusion Models10 Apr
  4. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Models11 Dec
  5. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec
  6. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
  7. 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
  8. 2023Divide & Bind Your Attention for Improved Generative Semantic Nursing20 Jul
  9. 2023A-STAR: Test-time Attention Segregation and Retention for Text-to-image Synthesis26 Jun
  10. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignment15 Jun
  11. 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
  12. 2023TextDiffuser: Diffusion Models as Text Painters18 May
1 more
  1. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Classifier-Free Diffusion Guidancecited by 5,847
  8. 2022Flow Matching for Generative Modelingcited by 5,702
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  12. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
13 more
  1. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 509
  2. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  3. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  4. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
  5. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  6. 2022Character-Aware Models Improve Visual Text Renderingcited by 92
  7. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
  8. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 53
  9. 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 48
  10. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 45
  11. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  12. 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 27
  13. 2025Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generationcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection
  2. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering
  3. 2023Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synthesis
  4. 2025Rare Text Semantics Were Always There in Your Diffusion Transformer
  5. 2025DCText: Scheduled Attention Masking for Visual Text Generation via Divide-and-Conquer Strategy
  6. 2025Towards Transformer-Based Aligned Generation with Self-Coherence Guidance
  7. 2024ARTIST: Improving the Generation of Text-rich Images with Disentangled Diffusion Models and Large Language Models
  8. 2025Precise Parameter Localization for Textual Generation in Diffusion Models