mlsanityData to 7 Oct 2026

FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing

arXiv 2505.03329 ↗First posted 6 May 2025cs.CVcited by 44

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Scene text editing aims to modify or add texts on images while ensuring text fidelity and overall visual quality consistent with the background. Recent methods are primarily built on UNet-based diffusion models, which have improved scene text editing results, but still struggle with complex glyph structures, especially for non-Latin ones (eg, Chinese, Korean, Japanese). To address these issues, we present FLUX-Text, a simple and advanced multilingual scene text editing DiT method. Specifically, our FLUX-Text enhances glyph understanding and generation through lightweight Visual and Text Embedding Modules, while preserving the original generative capability of FLUX. We further propose a Regional Text Perceptual Loss tailored for text regions, along with a matching two-stage training strategy to better balance text editing and overall image quality. Benefiting from the DiT-based architecture and lightweight feature injection modules, FLUX-Text can be trained with only 0.1M training examples, a 97% reduction compared to 2.9M required by popular methods. Extensive experiments on multiple public datasets, including English and Chinese benchmarks, demonstrate that our method surpasses other methods in visual quality and text fidelity. All the code is available at https://github.com/AMAP-ML/FluxText.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 59 references that are in the map. First posted on arXiv 6 May 2025.

Builds on

40 of 59 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
  2. 2024JoyType: A Robust Design for Multilingual Visual Text Creation26 Sep
  3. 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models2 Jul
  4. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation27 Feb
  5. 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model19 Dec
  6. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec
  7. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
  8. 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
  9. 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
  10. 2023TextDiffuser: Diffusion Models as Text Painters18 May
  11. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
2 more
  1. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
  2. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec

Other references · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  9. 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
  10. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  11. 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
  12. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
14 more
  1. 2023CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Modelcited by 48
  2. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  3. 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
  4. 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
  5. 2024RealisDance: Equip controllable character animation with realistic handscited by 37
  6. 2024BooW-VTON: Boosting In-the-Wild Virtual Try-On via Mask-Free Pseudo Data Trainingcited by 36
  7. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  8. 2024VisionLLaMA: A Unified LLaMA Backbone for Vision Taskscited by 28
  9. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  10. 2025USP: Unified Self-Supervised Pretraining for Image Generation and Understandingcited by 24
  11. 2024Visual Text Generation in the Wildcited by 22
  12. 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
  13. 2024CharGen: High Accurate Character-Level Visual Text Generation Model with MultiModal Encodercited by 14
  14. 2024Preference Alignment for Diffusion Model via Explicit Denoised Distribution Estimationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 30.

44 papers.

Sort:

By area:

  1. 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
  2. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
  3. 2025From Editor to Dense Geometry Estimatorcited by 20
  4. 2025SCALAR: Scale-wise Controllable Visual Autoregressive Learningcited by 18
  5. 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 14
  6. 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 11
  7. 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 9
  8. 2025Semantic Context Matters: Improving Conditioning for Autoregressive Modelscited by 7
  9. 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editingcited by 7
  10. 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methodscited by 5
  11. 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-oncited by 5
  12. 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
32 more
  1. 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generationcited by 5
  2. 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
  3. 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 4
  4. 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
  5. 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Renderingcited by 4
  6. 2025Effective Probabilistic Time Series Forecasting with Fourier Adaptive Noise-Separated Diffusioncited by 3
  7. 2025Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencodercited by 3
  8. 2025End-to-End Multi-Modal Diffusion Mambacited by 3
  9. 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Modelscited by 3
  10. 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Controlcited by 3
  11. 2025RAGSR: Regional Attention Guided Diffusion for Image Super-Resolutioncited by 2
  12. 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 2
  13. 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
  14. 2026InnoText: A Unified Model for Visual Text Generation and Editingcited by 2
  15. 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
  16. 2025SkyReels-Text: Fine-Grained Font-Controllable Text Editing for Poster Designcited by 1
  17. 2026AD-MIR: Bridging the Gap from Perception to Persuasion in Advertising Video Understanding via Structured Reasoningcited by 1
  18. 2026Leveraging Contrastive Learning for a Similarity-Guided Tampered Document Data Generation Pipelinecited by 1
  19. 2026POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generationcited by 1
  20. 2026TextWand: A Unified Framework for Scene Text Editingcited by 1
  21. 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learningcited by 0
  22. 2026MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generationcited by 0
  23. 2026Towards Training-Free Scene Text Editingcited by 0
  24. 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 0
  25. 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editingcited by 0
  26. 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learningcited by 0
  27. 2026TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generationcited by 0
  28. 2026PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Postercited by 0
  29. 2026LoGAN: Multilingual Font Localization with Generative Agentscited by 0
  30. 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Renderingcited by 0
  31. 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encodingcited by 0
  32. 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
  2. 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
  3. 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
  4. 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model
  5. 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection
  6. 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images
  7. 2026TextSculptor: Training and Benchmarking Scene Text Editing
  8. 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis