TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
Not on the map. Why?
Abstract (arXiv)
Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely unexplored, as it requires generating legible characters while preserving semantic, geometric, and contextual coherence. To fill this gap, we introduce TextEditBench, a comprehensive evaluation benchmark that explicitly focuses on text-centric regions in images. Beyond basic pixel manipulations, our benchmark emphasizes reasoning-intensive editing scenarios that require models to understand physical plausibility, linguistic meaning, and cross-modal dependencies. We further propose a novel evaluation dimension, Semantic Expectation (SE), which measures reasoning ability of model to maintain semantic consistency, contextual coherence, and cross-modal alignment during text editing. Extensive experiments on state-of-the-art editing systems reveal that while current models can follow simple textual instructions, they still struggle with context-dependent reasoning, physical consistency, and layout-aware integration. By focusing evaluation on this long-overlooked yet fundamental capability, TextEditBench establishes a new testing ground for advancing text-guided image editing and reasoning in multimodal generation.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
36 of 44 references.
References · 36
- 2024GPT-4o System Cardcited by 4,467
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 235
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
24 more
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
- 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
- 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
- 2022SinDDM: A Single Image Denoising Diffusion Modelcited by 60
- 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
- 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
- 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
- 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
- 2024CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Modelscited by 29
- 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 25
- 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 23
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 23
- 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
- 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 18
- 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
- 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
- 2024GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editingcited by 2
- 2026TextSculptor: Training and Benchmarking Scene Text Editingcited by 1
- 2026VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documentscited by 0
- 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editingcited by 0
- 2026UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generationcited by 0
- 2026UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation7 Oct 2026
- 2026ChartSync: A Benchmark for Visuo-Logical Cascading Chart Editing11 Jul 2026
- 2026TextSculptor: Training and Benchmarking Scene Text Editing20 May 2026
- 2026MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing4 May 2026
- 2026VDE Bench: Evaluating The Capability of Image Editing Models to Modify Visual Documents27 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Reasoning Fidelity in Visual Text Generation
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2025ReMix: Towards a Unified View of Consistent Character Generation and Editing
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing
- 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing