mlsanityData to 7 Oct 2026

ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement

arXiv 2608.28784 ↗First posted 28 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) have recently made strong progress in visual--linguistic understanding. However, their performance on text-centric video reasoning remains highly sensitive to input quality. Real-world user-provided videos often contain motion blur, compression artifacts, noise, and low-resolution text, which impair reliable text reading and downstream reasoning. Whether MLLMs can robustly read and reason about real-world scene text under diverse quality conditions remains a fundamental open question. We introduce ClearText-Video (CTVid), a large-scale, scene-text-aware benchmark for studying text-centric video understanding under controlled quality variation. CTVid contains 4,639 real-world text-rich egocentric videos, 550K+ frames, 1.6M human-verified scene-text annotations, and 220K+ spatial/temporal question--answer pairs in Chinese and English. For each high-quality video, CTVid provides content-matched Degraded-Quality and Restored-Quality variants, supporting two task families: Text-Centric Video Restoration and Multi-Quality VideoQA. We evaluate 18 representative restoration methods and 16 state-of-the-art MLLMs on CTVid. The results show that visual enhancement does not guarantee textual fidelity or downstream reasoning gains: blur is more damaging than low resolution, restored videos can alter the textual evidence used by MLLMs, and OCR-only pipelines remain far below direct multimodal reasoning. CTVid exposes the gap between video restoration and text-grounded understanding, providing a rigorous foundation for restoration-aware, quality-robust text-centric video systems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 60 of its 75 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

60 of 75 references.

References · 60

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  8. 2019Towards VQA Models That Can Readcited by 1,696
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  10. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  11. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
38 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  3. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  4. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  5. 2022Simple Baselines for Image Restorationcited by 701
  6. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  7. 2017Video Enhancement with Task-Oriented Flowcited by 612
  8. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
  9. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  10. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
  11. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  12. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
  13. 2018TVQA: Localized, Compositional Video Question Answeringcited by 463
  14. 2025Kimi-VL Technical Reportcited by 381
  15. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
  16. 2019Scene Text Visual Question Answeringcited by 327
  17. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
  18. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  19. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
  20. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  21. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  22. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
  23. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
  24. 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
  25. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
  26. 2017Detail-revealing Deep Video Super-resolutioncited by 147
  27. 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
  28. 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 133
  29. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
  30. 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
  31. 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
  32. 2020On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answeringcited by 78
  33. 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
  34. 2024CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Modelscited by 64
  35. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
  36. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
  37. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  38. 2025EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answeringcited by 43

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025VidText: Towards Comprehensive Evaluation for Video Text Understanding
  2. 2025TextVidBench: A Benchmark for Long Video Scene Text Understanding
  3. 2023Understanding Video Scenes through Text: Insights from Text-based Video Question Answering
  4. 2024VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded Text
  5. 2026Advancing Video-Text Pretraining with Multi-View Captions
  6. 2025ChineseVideoBench: Benchmarking Multi-modal Large Models for Chinese Video Question Answering
  7. 2026TEXTS-Diff: TEXTS-Aware Diffusion Model for Real-World Text Image Super-Resolution
  8. 2024TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment