FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Scene text editing aims to modify or add texts on images while ensuring text fidelity and overall visual quality consistent with the background. Recent methods are primarily built on UNet-based diffusion models, which have improved scene text editing results, but still struggle with complex glyph structures, especially for non-Latin ones (eg, Chinese, Korean, Japanese). To address these issues, we present FLUX-Text, a simple and advanced multilingual scene text editing DiT method. Specifically, our FLUX-Text enhances glyph understanding and generation through lightweight Visual and Text Embedding Modules, while preserving the original generative capability of FLUX. We further propose a Regional Text Perceptual Loss tailored for text regions, along with a matching two-stage training strategy to better balance text editing and overall image quality. Benefiting from the DiT-based architecture and lightweight feature injection modules, FLUX-Text can be trained with only 0.1M training examples, a 97% reduction compared to 2.9M required by popular methods. Extensive experiments on multiple public datasets, including English and Chinese benchmarks, demonstrate that our method surpasses other methods in visual quality and text fidelity. All the code is available at https://github.com/AMAP-ML/FluxText.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 59 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
40 of 59 references.
Closest ancestors · 14
Same direction, newest first
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
- 2024JoyType: A Robust Design for Multilingual Visual Text Creation26 Sep
- 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Models2 Jul
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generation27 Feb
- 2023Brush Your Text: Synthesize Any Scene Text on Images via Diffusion Model19 Dec
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Models8 Dec
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering28 Nov
- 2023AnyText: Multilingual Visual Text Generation And Editing6 Nov
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generation29 May
- 2023TextDiffuser: Diffusion Models as Text Painters18 May
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
2 more
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2023Prodigy: An Expeditiously Adaptive Parameter-Free Learnercited by 129
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 105
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
14 more
- 2023CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Modelcited by 48
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2024RealisDance: Equip controllable character animation with realistic handscited by 37
- 2024BooW-VTON: Boosting In-the-Wild Virtual Try-On via Mask-Free Pseudo Data Trainingcited by 36
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024VisionLLaMA: A Unified LLaMA Backbone for Vision Taskscited by 28
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2025USP: Unified Self-Supervised Pretraining for Image Generation and Understandingcited by 24
- 2024Visual Text Generation in the Wildcited by 22
- 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
- 2024CharGen: High Accurate Character-Level Visual Text Generation Model with MultiModal Encodercited by 14
- 2024Preference Alignment for Diffusion Model via Explicit Denoised Distribution Estimationcited by 2
Built on by
Citing papers per year: 2025: 14; 2026: 30.
44 papers.
Sort:
By area:
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2025From Editor to Dense Geometry Estimatorcited by 20
- 2025SCALAR: Scale-wise Controllable Visual Autoregressive Learningcited by 18
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 14
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 11
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 9
- 2025Semantic Context Matters: Improving Conditioning for Autoregressive Modelscited by 7
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editingcited by 7
- 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methodscited by 5
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-oncited by 5
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
32 more
- 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generationcited by 5
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
- 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 4
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Renderingcited by 4
- 2025Effective Probabilistic Time Series Forecasting with Fourier Adaptive Noise-Separated Diffusioncited by 3
- 2025Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencodercited by 3
- 2025End-to-End Multi-Modal Diffusion Mambacited by 3
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Modelscited by 3
- 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Controlcited by 3
- 2025RAGSR: Regional Attention Guided Diffusion for Image Super-Resolutioncited by 2
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 2
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
- 2026InnoText: A Unified Model for Visual Text Generation and Editingcited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2025SkyReels-Text: Fine-Grained Font-Controllable Text Editing for Poster Designcited by 1
- 2026AD-MIR: Bridging the Gap from Perception to Persuasion in Advertising Video Understanding via Structured Reasoningcited by 1
- 2026Leveraging Contrastive Learning for a Similarity-Guided Tampered Document Data Generation Pipelinecited by 1
- 2026POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generationcited by 1
- 2026TextWand: A Unified Framework for Scene Text Editingcited by 1
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learningcited by 0
- 2026MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generationcited by 0
- 2026Towards Training-Free Scene Text Editingcited by 0
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 0
- 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editingcited by 0
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learningcited by 0
- 2026TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generationcited by 0
- 2026PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Postercited by 0
- 2026LoGAN: Multilingual Font Localization with Generative Agentscited by 0
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Renderingcited by 0
- 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encodingcited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding29 Sep 2026
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering28 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Poster17 Aug 2026
- 2026TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation17 Aug 2026
- 2026InnoText: A Unified Model for Visual Text Generation and Editing24 Jul 2026
- 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Control22 Jun 2026
- 2026TextWand: A Unified Framework for Scene Text Editing4 Jun 2026
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning15 May 2026
- 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing4 May 2026
32 more
- 2026POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation27 Apr 2026
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation20 Apr 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Time13 Apr 2026
- 2026Towards Training-Free Scene Text Editing25 Mar 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Framework21 Mar 2026
- 2026GlyphPrinter: Region-Grouped Direct Preference Optimization for Glyph-Accurate Visual Text Rendering16 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generation6 Mar 2026
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers6 Mar 2026
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editing24 Feb 2026
- 2026Leveraging Contrastive Learning for a Similarity-Guided Tampered Document Data Generation Pipeline19 Feb 2026
- 2026AD-MIR: Bridging the Gap from Perception to Persuasion in Advertising Video Understanding via Structured Reasoning7 Feb 2026
- 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editing13 Jan 2026
- 2026MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generation9 Jan 2026
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-on24 Nov 2025
- 2025Semantic Context Matters: Improving Conditioning for Autoregressive Models18 Nov 2025
- 2025SkyReels-Text: Fine-Grained Font-Controllable Text Editing for Poster Design17 Nov 2025
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learning31 Oct 2025
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulation28 Oct 2025
- 2025End-to-End Multi-Modal Diffusion Mamba15 Oct 2025
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
- 2025RAGSR: Regional Attention Guided Diffusion for Image Super-Resolution22 Aug 2025
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generation11 Aug 2025
- 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methods4 Aug 2025
- 2025Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencoder28 Jul 2025
- 2025SCALAR: Scale-wise Controllable Visual Autoregressive Learning26 Jul 2025
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approach8 Jul 2025
- 2025Effective Probabilistic Time Series Forecasting with Fourier Adaptive Noise-Separated Diffusion16 May 2025
- 2025From Editor to Dense Geometry Estimatorcited by 20
- 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methodscited by 5
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformerscited by 5
- 2025Effective Probabilistic Time Series Forecasting with Fourier Adaptive Noise-Separated Diffusioncited by 3
- 2025Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencodercited by 3
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Modelscited by 3
- 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Controlcited by 3
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulationcited by 2
- 2026InnoText: A Unified Model for Visual Text Generation and Editingcited by 2
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learningcited by 0
- 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encodingcited by 0
- 2026STEPS: Scene Text Editing with Preserved Style Using Diffusion and Contrastive Style Encoding29 Sep 2026
- 2026InnoText: A Unified Model for Visual Text Generation and Editing24 Jul 2026
- 2026SteerVTE: Seamless Video Text Editing with Style and Glyph Control22 Jun 2026
- 2026Self-Prompting Diffusion Transformer for Open-Vocabulary Scene Text Editing via In-Context Learning15 May 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026Layer-wise Instance Binding for Regional and Occlusion Control in Text-to-Image Diffusion Transformers6 Mar 2026
- 2025OmniText: A Training-Free Generalist for Controllable Text-Image Manipulation28 Oct 2025
- 2025From Editor to Dense Geometry Estimator4 Sep 2025
- 2025Optimal Transport for Rectified Flow Image Editing: Unifying Inversion-Based and Direct Methods4 Aug 2025
- 2025Model-Agnostic Gender Bias Control for Text-to-Image Generation via Sparse Autoencoder28 Jul 2025
- 2025Effective Probabilistic Time Series Forecasting with Fourier Adaptive Noise-Separated Diffusion16 May 2025
- 2025End-to-End Multi-Modal Diffusion Mambacited by 3
- 2025End-to-End Multi-Modal Diffusion Mamba15 Oct 2025
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025SCALAR: Scale-wise Controllable Visual Autoregressive Learningcited by 18
- 2025Rethinking Layered Graphic Design Generation with a Top-Down Approachcited by 9
- 2025Semantic Context Matters: Improving Conditioning for Autoregressive Modelscited by 7
- 2025Eevee: Towards Close-up High-resolution Video-based Virtual Try-oncited by 5
- 2026InnoAds-Composer: Efficient Condition Composition for E-Commerce Poster Generationcited by 5
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
- 2026UM-Text: A Unified Multimodal Model for Image Understanding and Visual Text Editingcited by 4
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2025SkyReels-Text: Fine-Grained Font-Controllable Text Editing for Poster Designcited by 1
- 2026AD-MIR: Bridging the Gap from Perception to Persuasion in Advertising Video Understanding via Structured Reasoningcited by 1
12 most cited of 25 All 25 (JSON)
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering28 Sep 2026
- 2026LoGAN: Multilingual Font Localization with Generative Agents7 Sep 2026
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Poster17 Aug 2026
- 2026TransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation17 Aug 2026
- 2026TextWand: A Unified Framework for Scene Text Editing4 Jun 2026
- 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing4 May 2026
- 2026POCA: Pareto-Optimal Curriculum Alignment for Visual Text Generation27 Apr 2026
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation20 Apr 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026Towards Training-Free Scene Text Editing25 Mar 2026
12 newest of 25 All 25 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
- 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editing
- 2025SceneTextStylizer: A Training-Free Scene Text Style Transfer Framework with Diffusion Model
- 2026FreeText: Training-Free Text Rendering in Diffusion Transformers via Attention Localization and Spectral Glyph Injection
- 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images
- 2026TextSculptor: Training and Benchmarking Scene Text Editing
- 2025UniGlyph: Unified Segmentation-Conditioned Diffusion for Precise Visual Text Synthesis