T2LSC-Bench: Benchmarking Localized Semantic Control in Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
Recent text-to-image models have become increasingly capable of rendering explicit text, but reliable localized text control requires more than generating the correct string. In applications such as product labeling, signage, and interface design, target text should be rendered within a designated text-bearing region without altering the predefined subject identity or surrounding scene semantics. We refer to violations of this requirement as target-text-associated semantic leakage, in which target-text semantics are expressed through non-textual visual content beyond the designated anchor. Existing visual-text benchmarks primarily evaluate readability, spelling accuracy, and layout, leaving this form of semantic leakage largely unexamined. We introduce T2LSC-Bench, a controlled diagnostic benchmark comprising 50 seed subjects and 1,200 prompt cases per model, yielding 7,160 evaluated images across six models. Its factorized design varies semantic relation, scene openness, prompt mode, and language. A dual-branch protocol combines OCR-VLM text verification with structured VLM semantic judgments to measure Text-at-Anchor Accuracy (TAA), Semantic Subject Preservation (SSP), Semantic Leakage Rate (SLR), and Conditional Semantic Leakage Rate (cSLR). Under stress-test conditions, SLR increases from 1.2% to 18.1% and cSLR from 1.3% to 18.2%, whereas TAA decreases only from 91.4% to 90.9%. Anti-leakage prompting reduces SLR from 16.6% to 8.4% without degrading rendering accuracy. Human validation on 420 images shows strong agreement between automatic and adjudicated annotations. These results show that accurate text rendering does not guarantee local containment of target-text semantics.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 37 of its 43 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
37 of 43 references.
References · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
25 more
- 2022ReCo: Region-Controlled Text-to-Image Generationcited by 177
- 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 169
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2023Holistic Evaluation of Text-To-Image Modelscited by 160
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2022Character-Aware Models Improve Visual Text Renderingcited by 90
- 2023Divide & Bind Your Attention for Improved Generative Semantic Nursingcited by 80
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2023Conditional Text Image Generation with Diffusion Modelscited by 57
- 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Modelscited by 54
- 2024Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratingscited by 44
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024Visual Text Generation in the Wildcited by 22
- 2024Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Mapscited by 12
- 2024Addressing Text Embedding Leakage in Diffusion-based Image Editingcited by 7
- 2025STRICT: Stress Test of Rendering Images Containing Textcited by 7
- 2024Evaluating Semantic Variation in Text-to-Image Synthesis: A Causal Perspectivecited by 4
- 2025TextInVision: Text and Prompt Complexity Driven Visual Text Generation Benchmarkcited by 4
- 2024ARTIST: Improving the Generation of Text-rich Images with Disentangled Diffusion Models and Large Language Modelscited by 3
- 2025RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generationcited by 3
- 2025DeLeaker: Dynamic Inference-Time Reweighting For Semantic Leakage Mitigation in Text-to-Image Modelscited by 2
- 2025Consistent text-to-image generation via scene de-contextualizationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Decoupling semantics from vision: A framework for faithful visual-text compression evaluation
- 2026Beyond Legibility: Benchmarking Visual Text Rendering and In-Place Editing in Unified Video Generation
- 2025VISTAR:A User-Centric and Role-Driven Benchmark for Text-to-Image Evaluation
- 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generation
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
- 2024OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
- 2026ZeroSense:How Vision matters in Long Context Compression
- 2026Evaluating Reasoning Fidelity in Visual Text Generation