Investigating Text Insulation and Attention Mechanisms for Complex Visual Text Generation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present TextCrafter, a Complex Visual Text Generation (CVTG) framework inspired by selective visual attention in cognitive science, and introduce the "Text Insulation-and-Attention" mechanisms. To implement the selective-attention principle that selection operates on discrete objects, we propose a novel Bottleneck-aware Constrained Reinforcement Learning for Multi-text Insulation, which substantially improves text-rendering performance on the strong Qwen-Image pretrained model without introducing additional parameters. To align with the selective concentration principle in human vision, we introduce a text-oriented attention module with a novel Quotation-guided Attention Gate that further improves generation quality for each text instance. Our Reinforcement Learning based text insulation approach attains state-of-the-art results, and incorporating text-oriented attention yields additional gains on top of an already strong baseline. More importantly, we introduce CVTG-2K, a benchmark comprising 2,000 complex visual-text prompts. These prompts vary in positions, quantities, lengths, and attributes, and span diverse real-world scenarios. Extensive evaluations on CVTG-2K, CVTG-Hard, LongText-Bench, and Geneval datasets confirm the effectiveness of TextCrafter. Despite using substantially fewer resources (i.e., 4 GPUs) than industrial-scale models (e.g., Qwen-Image, GPT Image, and Seedream), TextCrafter achieves superior performance in mitigating text misgeneration, omissions, and hallucinations.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 42 of its 70 references that are in the map. First posted on arXiv 30 Mar 2025.
Builds on
42 of 70 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
30 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2022Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesiscited by 386
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 280
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 276
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
- 2018Scene Text Detection and Recognition: The Deep Learning Eracited by 114
- 2023Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restorationcited by 86
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillationcited by 66
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Modelcited by 41
- 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37
- 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 36
- 2023Diffusion Model for Camouflaged Object Detectioncited by 27
- 2023Attribute-Centric Compositional Text-to-Image Generationcited by 19
- 2024InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Captioncited by 17
- 2024Layout Agnostic Scene Text Image Synthesis with Diffusion Modelscited by 14
Built on by
Citing papers per year: 2025: 12; 2026: 10.
22 papers.
Sort:
By area:
- 2025Qwen-Image Technical Reportcited by 973
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025LongCat-Image Technical Reportcited by 92
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 16
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
- 2025Ovis-Image Technical Reportcited by 8
10 more
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformercited by 5
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 4
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2025TextGuider: Training-Free Guidance for Text Rendering via Attention Alignmentcited by 2
- 2026VAR RL Done Right: Tackling Asynchronous Policy Conflicts in Visual Autoregressive Generationcited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2026Amber-Image: Efficient Compression of Large-Scale Diffusion Transformerscited by 1
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusioncited by 0
- 2026S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generationcited by 0
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation17 Jul 2026
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion21 Jun 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Amber-Image: Efficient Compression of Large-Scale Diffusion Transformers19 Feb 2026
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing12 Feb 2026
- 2026VAR RL Done Right: Tackling Asynchronous Policy Conflicts in Visual Autoregressive Generation5 Jan 2026
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection2 Jan 2026
- 2025ThinkGen: Generalized Thinking for Visual Generation29 Dec 2025
- 2025TextGuider: Training-Free Guidance for Text Rendering via Attention Alignment10 Dec 2025
10 more
- 2025LongCat-Image Technical Report8 Dec 2025
- 2025Ovis-Image Technical Report28 Nov 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2025Emu3.5: Native Multimodal Models are World Learners30 Oct 2025
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Dataset23 Oct 2025
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer12 Aug 2025
- 2025Qwen-Image Technical Report4 Aug 2025
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection25 May 2025
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities5 May 2025
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation30 Apr 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformercited by 5
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injectioncited by 4
- 2025TextGuider: Training-Free Guidance for Text Rendering via Attention Alignmentcited by 2
- 2026Amber-Image: Efficient Compression of Large-Scale Diffusion Transformerscited by 1
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusioncited by 0
- 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusion21 Jun 2026
- 2026Amber-Image: Efficient Compression of Large-Scale Diffusion Transformers19 Feb 2026
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection2 Jan 2026
- 2025TextGuider: Training-Free Guidance for Text Rendering via Attention Alignment10 Dec 2025
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov 2025
- 2025Training-Free Text-Guided Color Editing with Multi-Modal Diffusion Transformer12 Aug 2025
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
- 2026S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generationcited by 0
- 2026S1-Omni: A Unified Multimodal Reasoning Model for Scientific Understanding, Prediction, and Generation17 Jul 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2025ThinkGen: Generalized Thinking for Visual Generation29 Dec 2025
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2025Emu3.5: Native Multimodal Models are World Learners30 Oct 2025
- 2025Qwen-Image Technical Reportcited by 973
- 2025LongCat-Image Technical Reportcited by 92
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Datasetcited by 16
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
- 2025Ovis-Image Technical Reportcited by 8
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
- 2026VAR RL Done Right: Tackling Asynchronous Policy Conflicts in Visual Autoregressive Generationcited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing12 Feb 2026
- 2026VAR RL Done Right: Tackling Asynchronous Policy Conflicts in Visual Autoregressive Generation5 Jan 2026
- 2025LongCat-Image Technical Report8 Dec 2025
- 2025Ovis-Image Technical Report28 Nov 2025
- 2025UltraHR-100K: Enhancing UHR Image Synthesis with A Large-Scale High-Quality Dataset23 Oct 2025
- 2025Qwen-Image Technical Report4 Aug 2025
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projection25 May 2025
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities5 May 2025
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluation30 Apr 2025