mlsanityData to 14 Oct 2026

ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing

arXiv 2609.40356 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent video generation is increasingly realistic and controllable, yet video editing remains less developed, particularly for precise local edits that must preserve the original scene dynamics. Video scene text editing replaces text on scene surfaces, such as storefront signs, whiteboards, and product labels, while preserving the surrounding content, motion, and camera dynamics. Although scene text editing is well studied for images, video scene text editing that achieves high visual quality, temporal consistency, and edit locality remains underexplored. Existing resources offer limited paired real-video data, and general video-editing metrics do not directly measure whether the requested text remains correct over time. We introduce ViTeX-Bench, a benchmark suite comprising ViTeX-Dataset and a three-axis evaluation protocol. The dataset contains 387 real-world 720p videos with text-region masks and editing instructions: 230 provide reviewed, pipeline-generated paired edits for training, and 157 form a frozen evaluation split. The protocol evaluates text correctness, visual and temporal quality, and edit locality through 13 metrics, with one primary metric per axis and a Pareto comparison of their trade-offs. OCR calibration, human evaluation, and annotation-sensitivity analyses support the interpretation of these scores. Across eight baselines from four editing families, accurate text, temporal stability, and scene preservation remain difficult to achieve together. We also release ViTeX-Edit-14B, an open-source reference editor fine-tuned on the paired training split with motion-aligned glyph-video conditioning. It achieves CharAcc 0.688, the highest mean among the evaluated video-native editors, and the lowest comparable text-crop Warp among raw editor outputs. ViTeX-Bench provides a reproducible foundation for studying these trade-offs in video scene text editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 79 of its 91 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

79 of 91 references.

References · 79

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2022Video Diffusion Modelscited by 2,305
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
38 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  2. 2018Datasheets for Datasetscited by 1,386
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  4. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  5. 2025SAM 3: Segment Anything with Conceptscited by 906
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  9. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  10. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  11. 2025VACE: All-in-One Video Creation and Editingcited by 479
  12. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  13. 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 466
  14. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  15. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  16. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  17. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  18. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  19. 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
  20. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  21. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  22. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  23. 2023TextDiffuser: Diffusion Models as Text Painterscited by 229
  24. 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
  25. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
  26. 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 163
  27. 2025Do generative video models understand physical principles?cited by 161
  28. 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 154
  29. 2025PaddleOCR 3.0 Technical Reportcited by 143
  30. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
  31. 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
  32. 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
  33. 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 84
  34. 2019Editing Text in the Wildcited by 82
  35. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
  36. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
  37. 2023FlowVid: Taming Imperfect Optical Flows for Consistent Video-to-Video Synthesiscited by 79
  38. 2023UDiffText: A Unified Framework for High-quality Text Synthesis in Arbitrary Images via Character-aware Diffusion Modelscited by 59

50 most cited of 79 All 79 (JSON)

Built on by

Not cited yet.