TextWand: A Unified Framework for Scene Text Editing
Not on the map. Why?
Abstract (arXiv)
We propose TextWand, a general-purpose framework that unifies scene text removal, generation, and replacement into a single model. By decomposing complex editing tasks into the atomic primitives of rendering and erasure, TextWand achieves precise control over both text appearance and background integrity. Specifically, we introduce a novel design, Overlay-Reference Positional Encoding (ORPE), to enforce pixel-level layout fidelity and exemplar-driven style control, alongside a new strategy, Region-Adaptive Suppression (RAS), to ensure clean text erasure. To address the absence of a comprehensive benchmark for general-purpose scene text editing among existing single-task datasets, we construct TextWand-Bench. Extensive experiments demonstrate that TextWand outperforms existing leading open-source and closed-source models by delivering superior text content accuracy, layout and style consistency, and overall image quality across scene text removal, generation and replacement tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 54 of its 63 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
54 of 63 references.
References · 54
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
38 more
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 214
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2025LongCat-Image Technical Reportcited by 92
- 2024DiffEditor: Boosting Accuracy and Flexibility on Diffusion-based Image Editingcited by 88
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
- 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 58
- 2023FontDiffuser: One-Shot Font Generation via Denoising Diffusion with Multi-Scale Content Aggregation and Style Contrastive Learningcited by 48
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2024TextCtrl: Diffusion-based Scene Text Editing with Prior Guidance Controlcited by 44
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 44
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 37
- 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
- 2017Scene Text Erasercited by 26
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Renderingcited by 25
- 2019MTRNet++: One-stage Mask-based Scene Text Erasercited by 24
- 2021Stroke-Based Scene Text Erasing Using Synthetic Data for Trainingcited by 20
- 2025Visual Text Processing: A Comprehensive Review and Unified Evaluationcited by 18
- 2024DiffusionPen: Towards Controlling the Style of Handwritten Text Generationcited by 16
- 2022The Surprisingly Straightforward Scene Text Removal Method With Gated Attention and Region of Interest Generation: A Comprehensive Prominent Model Analysiscited by 13
- 2025Recognition-Synergistic Scene Text Editingcited by 11
- 2025ControlText: Unlocking Controllable Fonts in Multilingual Text Rendering without Font Annotationscited by 10
- 2025GlyphMastero: A Glyph Encoder for High-Fidelity Scene Text Editingcited by 10
- 2024Intelligent Artistic Typography: A Comprehensive Review of Artistic Text Design and Generationcited by 9
- 2025EditInfinity: Image Editing with Binary-Quantized Generative Modelscited by 6
- 2025UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Imagescited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.