mlsanityData to 7 Oct 2026

TextSculptor: Training and Benchmarking Scene Text Editing

arXiv 2605.21090 ↗First posted 20 May 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

also in 1 more
Abstract (arXiv)

Recent advances in Multimodal Large Language Models (MLLMs) and diffusion-based generative models have substantially improved prompt-driven image editing. However, scene text editing remains challenging, as it requires models to precisely modify textual content while preserving visual realism and non-target regions. Current open-source models still lag behind proprietary systems, largely due to the scarcity of high-quality training data and the lack of standardized benchmarks tailored to text editing. To address these challenges, we present TextSculptor, a comprehensive framework for data construction and evaluation of scene text editing. We first develop an automated data construction pipeline that combines text-aware image synthesis with programmatic text rendering and compositing. Based on this pipeline, we build TextSculpt-Data, a large-scale dataset containing 3.2M training samples, including 1.2M OCR-verified text-to-image samples and 2M paired text editing samples with naturally aligned source-target images and strong background consistency. We further introduce TextSculpt-Bench, a benchmark covering four fundamental text editing tasks: text addition, text replacement, text removal, and hybrid editing. To support reliable evaluation, we design a tailored protocol that measures text accuracy, visual quality, and background preservation through OCR-based text alignment, multimodal judgment, and background-region similarity. Extensive experiments show that TextSculptor improves open-source text editing performance and narrows the gap to proprietary models. The data and benchmark are available at https://github.com/linyiheng123/TextSculptor.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

26 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Qwen3-VL Technical Report26 Nov
  2. 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception11 Jul

Other references · 24

  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  4. 2023DataComp: In search of the next generation of multimodal datasetscited by 635
  5. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  6. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  7. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  8. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  9. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  10. 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
  11. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  12. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
12 more
  1. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  2. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  3. 2025LongCat-Image Technical Reportcited by 92
  4. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
  5. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  6. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
  7. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
  8. 2025TextAtlas5M: A Large-scale Dataset for Dense Text Image Generationcited by 25
  9. 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
  10. 2025ThinkGen: Generalized Thinking for Visual Generationcited by 12
  11. 2026WeEdit: A Dataset, Benchmark and Glyph-Guided Framework for Text-centric Image Editingcited by 6
  12. 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Renderingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024TextMastero: Mastering High-Quality Scene Text Editing in Diverse Languages and Styles
  2. 2025TextFlux: An OCR-Free DiT Model for High-Fidelity Multilingual Scene Text Synthesis
  3. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editing
  4. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  5. 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders
  6. 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Models
  7. 2024Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing
  8. 2023Editing 3D Scenes via Text Prompts without Retraining