ClearText-Video: A Large-Scale Text-Centric Video Dataset Bridging Video Restoration and Scene-Text Enhancement
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have recently made strong progress in visual--linguistic understanding. However, their performance on text-centric video reasoning remains highly sensitive to input quality. Real-world user-provided videos often contain motion blur, compression artifacts, noise, and low-resolution text, which impair reliable text reading and downstream reasoning. Whether MLLMs can robustly read and reason about real-world scene text under diverse quality conditions remains a fundamental open question. We introduce ClearText-Video (CTVid), a large-scale, scene-text-aware benchmark for studying text-centric video understanding under controlled quality variation. CTVid contains 4,639 real-world text-rich egocentric videos, 550K+ frames, 1.6M human-verified scene-text annotations, and 220K+ spatial/temporal question--answer pairs in Chinese and English. For each high-quality video, CTVid provides content-matched Degraded-Quality and Restored-Quality variants, supporting two task families: Text-Centric Video Restoration and Multi-Quality VideoQA. We evaluate 18 representative restoration methods and 16 state-of-the-art MLLMs on CTVid. The results show that visual enhancement does not guarantee textual fidelity or downstream reasoning gains: blur is more damaging than low resolution, restored videos can alter the textual evidence used by MLLMs, and OCR-only pipelines remain far below direct multimodal reasoning. CTVid exposes the gap between video restoration and text-grounded understanding, providing a rigorous foundation for restoration-aware, quality-robust text-centric video systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 60 of its 75 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
60 of 75 references.
References · 60
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2019Towards VQA Models That Can Readcited by 1,696
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
38 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2022Simple Baselines for Image Restorationcited by 701
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 463
- 2025Kimi-VL Technical Reportcited by 381
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
- 2019Scene Text Visual Question Answeringcited by 327
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 211
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 174
- 2024VITA: Towards Open-Source Interactive Omni Multimodal LLMcited by 172
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2017Detail-revealing Deep Video Super-resolutioncited by 147
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 139
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 133
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2024LayoutLLM: Layout Instruction Tuning with Large Language Models for Document Understandingcited by 94
- 2024MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answeringcited by 93
- 2020On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answeringcited by 78
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2024CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Modelscited by 64
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 64
- 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolutioncited by 59
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
- 2025EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answeringcited by 43
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025VidText: Towards Comprehensive Evaluation for Video Text Understanding
- 2025TextVidBench: A Benchmark for Long Video Scene Text Understanding
- 2023Understanding Video Scenes through Text: Insights from Text-based Video Question Answering
- 2024VCR: A Task for Pixel-Level Complex Reasoning in Vision Language Models via Restoring Occluded Text
- 2026Advancing Video-Text Pretraining with Multi-View Captions
- 2025ChineseVideoBench: Benchmarking Multi-modal Large Models for Chinese Video Question Answering
- 2026TEXTS-Diff: TEXTS-Aware Diffusion Model for Real-World Text Image Super-Resolution
- 2024TOPA: Extending Large Language Models for Video Understanding via Text-Only Pre-Alignment