mlsanityData to 14 Oct 2026

NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video

arXiv 2608.13210 ↗First posted 13 Aug 2026cs.CV cs.AI cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-form video understanding encompasses tasks that go beyond retrieving isolated events, including tracking an evolving narrative and interpreting social meaning that may remain implicit. However, existing benchmarks rarely evaluate these capabilities jointly, particularly in high-context, non-English media. To address this gap, we introduce NARU, a benchmark designed to evaluate Narrative evolution and Reasoning on cultural Understanding in Japanese long-form video. NARU consists of 1,481 questions grounded in 155 videos totaling 146.8 hours, spanning four narrative and five cultural dimensions. To construct the benchmark at this scale, we propose a hierarchical memory-based annotation pipeline that transforms raw video into structured event, narrative, and cultural annotations, then generates questions via task-oriented synthesis and iterative shortcut removal. The construction process includes two native-speaker verification stages involving 68 annotators. Evaluations across eight model configurations reveal substantial limitations in both long-range narrative integration and culturally grounded reasoning. By exposing these persistent gaps, NARU offers a systematic testing ground for developing MLLMs capable of reliably interpreting long-form, high-context video.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 49 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

8 of 49 references.

References · 8

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025Qwen3-VL Technical Reportcited by 2,793
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  4. 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
  5. 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 114
  6. 2026MIRAGE: The Illusion of Visual Understandingcited by 65
  7. 2024From Seconds to Hours: Reviewing MultiModal Large Language Models on Comprehensive Long Video Understandingcited by 30
  8. 2026NarrativeTrack: Evaluating Entity-Centric Reasoning for Narrative Understandingcited by 3

Built on by

Not cited yet.