TextSculptor: Training and Benchmarking Scene Text Editing
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
also in 1 more
Abstract (arXiv)
Recent advances in Multimodal Large Language Models (MLLMs) and diffusion-based generative models have substantially improved prompt-driven image editing. However, scene text editing remains challenging, as it requires models to precisely modify textual content while preserving visual realism and non-target regions. Current open-source models still lag behind proprietary systems, largely due to the scarcity of high-quality training data and the lack of standardized benchmarks tailored to text editing. To address these challenges, we present TextSculptor, a comprehensive framework for data construction and evaluation of scene text editing. We first develop an automated data construction pipeline that combines text-aware image synthesis with programmatic text rendering and compositing. Based on this pipeline, we build TextSculpt-Data, a large-scale dataset containing 3.2M training samples, including 1.2M OCR-verified text-to-image samples and 2M paired text editing samples with naturally aligned source-target images and strong background consistency. We further introduce TextSculpt-Bench, a benchmark covering four fundamental text editing tasks: text addition, text replacement, text removal, and hybrid editing. To support reliable evaluation, we design a tailored protocol that measures text accuracy, visual quality, and background preservation through OCR-based text alignment, multimodal judgment, and background-region similarity. Extensive experiments show that TextSculptor improves open-source text editing performance and narrows the gap to proprietary models. The data and benchmark are available at https://github.com/linyiheng123/TextSculptor.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
26 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2025Qwen3-VL Technical Report26 Nov
- 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception11 Jul
Other references · 24
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023DataComp: In search of the next generation of multimodal datasetscited by 635
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
12 more
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025LongCat-Image Technical Reportcited by 92
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
- 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
- 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
- 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 25
- 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
- 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
- 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editingcited by 6
- 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Renderingcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
- 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders
- 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Models
- 2024Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing
- 2023Editing 3D Scenes via Text Prompts without Retraining