LongVQUBench: Benchmarking Long-Term Video Quality Understanding of Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Video understanding with MLLMs
Abstract (arXiv)
The evaluation of long-term video quality understanding remains an open challenge for large vision-language models (LVLMs). Existing video quality benchmarks predominantly focus on short clips and isolated distortions, overlooking the temporal continuity, cumulative degradation, and reasoning complexity inherent in long-duration content. To address these limitations, we present LongVQUBench, a comprehensive benchmark for long-term video quality understanding. LongVQUBench contains over 1200 diverse videos spanning movies, documentaries, surveillance footage, egocentric recordings, and animated content, accompanied by 1500 multiple-choice and open-ended questions for validation and testing. To assess perceptual reasoning across different temporal scopes, we introduce three progressively complex evaluation levels: (i) local event quality understanding (LQU) for analyzing localized distortions; (ii) cross-event quality reasoning (CQR) for integrating multiple degraded events; and (iii) global quality understanding (GQU) for holistic perceptual evaluation over extended durations. Furthermore, a needle distortion question-answering (NDQA) paradigm is embedded across all three levels, where spatial or temporal artifacts are sparsely inserted to probe fine-grained detection and reasoning capabilities. Extensive experiments on 14 state-of-the-art LVLMs reveal significant performance degradation with increasing video length and reasoning depth, highlighting their limited capacity for long-range temporal integration and perceptual attribution. We envision LongVQUBench as a foundational step toward the systematic, hierarchical, and explainable evaluation of LVLMs' long-term video quality understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video understanding with MLLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 54 of its 101 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
54 of 101 references.
Closest ancestors · 9
Same direction, newest first
- 2025LongVT: Incentivizing "Thinking with Long Videos" via Native Tool Calling25 Nov
- 2025Scaling RL to Long Videos10 Jul
- 2025LOVE: Benchmarking and Evaluating Text-to-Video Generation and Video-to-Text Interpretation17 May
- 2024Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs30 Sep
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models9 Aug
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding22 Jul
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding20 Jun
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis31 May
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projection16 Nov
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
33 more
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 542
- 2024ShareGPT4Video: Improving Video Understanding and Generation with Better Captionscited by 388
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 292
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2019Quality Assessment of In-the-Wild Videoscited by 164
- 2019YouTube UGC Dataset for Video Compression Researchcited by 124
- 2025Deep Video Discovery: Agentic Search with Tool Use for Long-form Video Understandingcited by 98
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2025VideoExplorer: Think With Videos For Agentic Long-Video Understandingcited by 29
- 2025VQ-Insight: Teaching VLMs for AI-Generated Video Quality Understanding via Progressive Visual Reinforcement Learningcited by 26
- 2023Movie101: A New Movie Understanding Benchmarkcited by 25
- 2024Modular Blind Video Quality Assessmentcited by 23
- 2019C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Networkcited by 22
- 2023LVQAC: Lattice Vector Quantization Coupled with Spatially Adaptive Companding for Efficient Learned Image Compressioncited by 19
- 2021Attention-guided Image Compression by Deep Reconstruction of Compressive Sensed Saliency Skeletoncited by 16
- 2024VQA2: Visual Question Answering for Video Quality Assessmentcited by 15
- 2024Video Quality Assessment: A Comprehensive Surveycited by 15
- 2021Multi-modality Deep Restoration of Extremely Compressed Face Videoscited by 14
- 2019PEA265: Perceptual Assessment of Video Compression Artifactscited by 10
- 2025BADiff: Bandwidth Adaptive Diffusion Modelcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Q-CLIP: Unleashing the Power of Vision-Language Models for Video Quality Assessment through Unified Cross-Modal Adaptation
- 2025HLV-1K: A Large-scale Hour-Long Video Benchmark for Time-Specific Long Video Understanding
- 2025Does Your Vision-Language Model Get Lost in the Long Video Sampling Dilemma?
- 2025VidLBEval: Benchmarking and Mitigating Language Bias in Video-Involved LVLMs
- 2026MVPBench: A Multi-Video Perception Evaluation Benchmark for Multi-Modal Video Understanding
- 2025Context and Pixel Aware Large Language Model for Video Quality Assessment
- 2025MMLongCite: A Benchmark for Evaluating Fidelity of Long-Context Vision-Language Models
- 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMs