TextMaster: A Unified Framework for Realistic Text Editing via Glyph-Style Dual-Control
Not on the map. Why?
Abstract (arXiv)
In image editing tasks, high-quality text editing capabilities can significantly reduce both human and material resource costs. Existing methods, however, face significant limitations in terms of stroke accuracy for complex text and controllability of generated text styles. To address these challenges, we propose TextMaster, a solution capable of accurately editing text across various scenarios and image regions, while ensuring proper layout and controllable text style. Our method enhances the accuracy and fidelity of text rendering by incorporating high-resolution standard glyph information and applying perceptual loss within the text editing region. Additionally, we leverage an attention mechanism to compute intermediate layer bounding box regression loss for each character, enabling the model to learn text layout across varying contexts. Furthermore, we propose a novel style injection technique that enables controllable style transfer for the injected text. Through comprehensive experiments, we demonstrate the state-of-the-art performance of our method.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 32 of its 41 references that are in the map. First posted on arXiv 13 Oct 2024.
Builds on
32 of 41 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
20 more
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 247
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 131
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2022PP-OCRv3: More Attempts for the Improvement of Ultra Lightweight OCR Systemcited by 106
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 81
- 2023CAT-DM: Controllable Accelerated Virtual Try-on with Diffusion Modelcited by 48
- 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 48
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 45
- 2024GlyphDraw2: Automatic Generation of Complex Glyph Posters with Diffusion Models and Large Language Modelscited by 29
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewardscited by 5
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priorscited by 2
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editingcited by 0
- 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generationcited by 0
- 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation13 Oct 2026
- 2026GlyphAnchor: Enhancing Visual Text Rendering via Position-Anchored Glyph Priors2 Sep 2026
- 2026TextAlign: Preference Alignment for Text Rendering with Hierarchical Rewards19 May 2026
- 2026Edit Fidelity Field: Semantics-Aware Region Isolation for Training-Free Scene Text Editing19 Apr 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026