Training-Free Occluded Text Rendering via Glyph Priors and Attention-Guided Semantic Blending
Not on the map. Why?
Abstract (arXiv)
We present a training-free framework for occluded text rendering with a pretrained FLUX.1-dev backbone. The task requires a model to render recognizable typography and place an occluding object over the intended text region. This setting remains difficult for existing text-to-image generators: the occluder often drifts away from the text, while the text may be distorted or appear to float on top of the occluding object. To address this problem, we propose a restarted dual-stream inference framework that decouples text-layout preservation from occluder insertion. A Base Stream provides a clean typographic reference and same-step key/value (K/V) features, while the Edit Stream is conditioned on the occlusion prompt. We further adopt the spectral glyph-prior idea from FreeText and adapt it to stabilize the target text structure during early-to-mid denoising. In the reasoning pass, our method localizes the target text, estimates a text-band region from token-conditioned attention and glyph support, and derives an anchor-aware hard fusion mask for the occluder. In the final edit pass, generation restarts from the same initial noise and applies hard mask-guided image-token K/V replacement at selected attention sites, preserving the Base layout outside the mask while injecting the occluder appearance from the Edit Stream inside the mask. Experiments on representative occluded text scenarios demonstrate substantially improved text readability and competitive occlusion alignment, yielding more stable object-on-text compositions without any model fine-tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 18 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
16 of 18 references.
References · 16
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2022Blended Latent Diffusioncited by 432
- 2022What the DAAM: Interpreting Stable Diffusion Using Cross Attentioncited by 236
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
4 more
- 2025FreeFlux: Understanding and Exploiting Layer-Specific Roles in RoPE-Based MMDiT for Versatile Image Editingcited by 22
- 2025LaRender: Training-Free Occlusion Control in Image Generation via Latent Renderingcited by 11
- 2025Anchor Token Matching: Implicit Structure Locking for Training-free AR Image Editingcited by 10
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 5
Built on by
Not cited yet.