HDGlyph: A Hierarchical Disentangled Glyph-Based Framework for Long-Tail Text Rendering in Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Visual text rendering, which aims to accurately integrate specified textual content within generated images, is critical for various applications such as commercial design. Despite recent advances, current methods struggle with long-tail text cases, particularly when handling unseen or small-sized text. In this work, we propose a novel Hierarchical Disentangled Glyph-Based framework (HDGlyph) that hierarchically decouples text generation from non-text visual synthesis, enabling joint optimization of both common and long-tail text rendering. At the training stage, HDGlyph disentangles pixel-level representations via the Multi-Linguistic GlyphNet and the Glyph-Aware Perceptual Loss, ensuring robust rendering even for unseen characters. At inference time, HDGlyph applies Noise-Disentangled Classifier-Free Guidance and Latent-Disentangled Two-Stage Rendering (LD-TSR) scheme, which refines both background and small-sized text. Extensive evaluations show our model consistently outperforms others, with 5.08% and 11.7% accuracy gains in English and Chinese text rendering while maintaining high image quality. It also excels in long-tail scenarios with strong accuracy and visual performance.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 17 of its 25 references that are in the map. First posted on arXiv 10 May 2025.
Builds on
17 of 25 references.
Closest ancestors · 11
Same direction, newest first
- 2024JoyType: A Robust Design for Multilingual Visual Text Creation26 Sep
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Models3 Jun
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model19 Dec
- 2023FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition12 Dec
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
- 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
- 2023TextDiffuser: Diffusion Models as Text Painters18 May
- 2023DiffUTE: Universal Text Editing Diffusion Model18 May
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation16 Feb
Other references · 6
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 53
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors
- 2023GlyphDiffusion: Text Generation as Image Generation
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2024Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection
- 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering
- 2024Refining Text-to-Image Generation: Towards Accurate Training-Free Glyph-Enhanced Image Generation