mlsanityData to 7 Oct 2026

InnoText: A Unified Model for Visual Text Generation and Editing

arXiv 2607.22101 ↗First posted 24 Jul 2026cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models have recently achieved remarkable success in high-fidelity image synthesis, yet their application to visual text generation and editing remains relatively underexplored. Unlike general image generation, visual text tasks demand precise structural regularity and legibility, which may pose additional challenges for small-scale text and non-Latin scripts such as Chinese. Existing UNet-based models often struggle to produce clear and coherent text, while DiT-based models, though more expressive, are typically limited to a single task, which may lead to redundant training pipelines, inconsistent visual styles, and reduced cross-task generalization. To address these challenges, we propose InnoText, a unified DiT-based framework capable of performing both text generation and editing within a single model. We introduce a Font Size-Aware Modulation (FSAM) module to enhance representations across font scales, a Small-Character Aware Augmentation strategy to improve fine-grained fidelity, and a Task-Specific Region Weighted Loss for adaptive optimization. To support training and evaluation, we also construct a high-quality bilingual (English-Chinese) visual text dataset covering diverse fonts, sizes, and backgrounds. Experimental results demonstrate that our method achieves superior generation accuracy and editing quality, producing visually appealing and realistic text images.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 42 of its 44 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

42 of 44 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Lay2Story: Extending Diffusion Transformers for Layout-Togglable Story Generation12 Aug
  2. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering30 May
  3. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing6 May
  4. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
  5. 2025U-StyDiT: Ultra-high Quality Artistic Style Transfer Using Diffusion Transformers11 Mar
  6. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Model10 Mar
  7. 2025ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotations16 Feb
  8. 2024How Control Information Influences Multilingual Text Image Generation and Editing?16 Jul
  9. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec
  10. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
  11. 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
4 more
  1. 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
  2. 2023TextDiffuser: Diffusion Models as Text Painters18 May
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb

Other references · 26

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  7. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  8. 2017NIMA: Neural Image Assessmentcited by 387
  9. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  10. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  11. 2025WISA: World Simulator Assistant for Physics-Aware Text-to-Video Generationcited by 87
  12. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
14 more
  1. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  2. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  3. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
  4. 2024Visual Text Generation in the Wildcited by 22
  5. 2025RelaCtrl: Relevance-Guided Efficient Control for Diffusion Transformerscited by 18
  6. 2024DreamText: High Fidelity Scene Text Synthesiscited by 17
  7. 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
  8. 2024CharGen: High Accurate Character-Level Visual Text Generation Model with MultiModal Encodercited by 14
  9. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesiscited by 12
  10. 2025IC-Custom: Diverse Image Customization via In-Context Learningcited by 10
  11. 2025RepText: Rendering Visual Text via Replicatingcited by 7
  12. 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generationcited by 6
  13. 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generationcited by 5
  14. 2026Design Your Ad: Personalized Advertising Image and Text Generation with Unified Autoregressive Modelscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024JoyType: A Robust Design for Multilingual Visual Text Creation
  2. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders
  3. 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Images
  4. 2024Empowering Backbone Models for Visual Text Generation with Input Granularity Control and Glyph-Aware Training
  5. 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editing
  6. 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
  7. 2024Conditional Text-to-Image Generation with Reference Guidance
  8. 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images