mlsanityData to 7 Oct 2026

TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering

arXiv 2512.16270 ↗First posted 18 Dec 2025cs.CV cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely unexplored, as it requires generating legible characters while preserving semantic, geometric, and contextual coherence. To fill this gap, we introduce TextEditBench, a comprehensive evaluation benchmark that explicitly focuses on text-centric regions in images. Beyond basic pixel manipulations, our benchmark emphasizes reasoning-intensive editing scenarios that require models to understand physical plausibility, linguistic meaning, and cross-modal dependencies. We further propose a novel evaluation dimension, Semantic Expectation (SE), which measures reasoning ability of model to maintain semantic consistency, contextual coherence, and cross-modal alignment during text editing. Extensive experiments on state-of-the-art editing systems reveal that while current models can follow simple textual instructions, they still struggle with context-dependent reasoning, physical consistency, and layout-aware integration. By focusing evaluation on this long-overlooked yet fundamental capability, TextEditBench establishes a new testing ground for advancing text-guided image editing and reasoning in multimodal generation.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 36 of its 44 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

36 of 44 references.

References · 36

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2025Qwen-Image Technical Reportcited by 973
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  4. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  7. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 398
  8. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  9. 2016COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Imagescited by 235
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  11. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  12. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
24 more
  1. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  2. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 165
  3. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 136
  4. 2023GlyphControl: Glyph Conditional Control for Visual Text Generationcited by 127
  5. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  6. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
  7. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  8. 2024Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Renderingcited by 80
  9. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  10. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  11. 2022SinDDM: A Single Image Denoising Diffusion Modelcited by 60
  12. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  13. 2024AnyText2: Visual Text Generation and Editing With Customizable Attributescited by 48
  14. 2024Glyph-ByT5-v2: A Strong Aesthetic Baseline for Accurate Multilingual Visual Text Renderingcited by 47
  15. 2023GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generationcited by 34
  16. 2024CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Modelscited by 29
  17. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 25
  18. 2025UniGenBench++: A Unified Semantic Evaluation Benchmark for Text-to-Image Generationcited by 23
  19. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 23
  20. 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
  21. 2025BizGen: Advancing Article-level Visual Text Rendering for Infographics Generationcited by 18
  22. 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
  23. 2025LeX-Art: Rethinking Text Generation via Scalable High-Quality Data Synthesiscited by 15
  24. 2024GIEBench: Towards Holistic Evaluation of Group Identity-based Empathy for Large Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Reasoning Fidelity in Visual Text Generation
  2. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
  3. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
  4. 2025ReMix: Towards a Unified View of Consistent Character Generation and Editing
  5. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing
  6. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
  7. 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
  8. 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing