TAKE 85: Testing Audiovisual filmmaKer's intEnt across 85 Hours of Film
Not on the map. Why?
Abstract (arXiv)
Films communicate through deliberate creative choices, including lighting, color, composition, editing, dialogue, music, and sound. Humans naturally interpret these signals as directorial intent, yet current multimodal large language models (MLLMs) are evaluated almost exclusively on understanding what happens rather than why it is presented that way. We introduce TAKE 85, the first benchmark for directorial-intent understanding, comprising 398 short films (85 hours) with expert-verified question-answer pairs spanning global and fine-grained visual and audio intent. Through controlled modality ablations, TAKE 85 enables systematic evaluation of multimodal reasoning. Experiments on state-of-the-art MLLMs reveal a substantial gap between perceptual recognition and intentional understanding: while models accurately describe events and narratives, they consistently fail to infer the communicative role of filmmaking decisions. Our results establish directorial intent as a previously overlooked dimension of multimodal understanding: even the strongest model reaches only 58 out of 100, and our ablations show that no input modality is sufficient on its own. All code, Q&As, and models are publicly available from https://github.com/KaiShinozakiConefrey/Take-85
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 44 of its 59 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
44 of 59 references.
References · 44
- 2023GPT-4 Technical Reportcited by 18,396
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2017Dense-Captioning Events in Videoscited by 793
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
- 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
- 2023Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioningcited by 263
- 2026Gemma 4 Technical Reportcited by 259
32 more
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 219
- 2018End-to-End Dense Video Captioning with Masked Transformercited by 214
- 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
- 2023Video Understanding with Large Language Models: A Surveycited by 206
- 2021Towards Long-Form Video Understandingcited by 146
- 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 114
- 2024Video ReCap: Recursive Captioning of Hour-Long Videoscited by 89
- 2024Streaming Dense Video Captioningcited by 82
- 2018Bidirectional Attentive Fusion with Context Gating for Dense Video Captioningcited by 68
- 2025Towards Understanding Camera Motions in Any Videocited by 64
- 2022From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-Answeringcited by 51
- 2023AutoAD: Movie Description in Contextcited by 50
- 2023AutoAD II: The Sequel -- Who, When, and What in Movie Audio Descriptioncited by 49
- 2023MM-Narrator: Narrating Long-form Videos with Multimodal In-Context Learningcited by 46
- 2020A Unified Framework for Shot Type Classification Based on Subject Centric Lenscited by 44
- 2024AutoAD III: The Prequel -- Back to the Pixelscited by 35
- 2025SAM Audio: Segment Anything in Audiocited by 30
- 2024AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Descriptioncited by 23
- 2025CineTechBench: A Benchmark for Cinematographic Technique Understanding and Generationcited by 23
- 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Modelscited by 22
- 2024VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?cited by 18
- 2024Contextual AD Narration with Interleaved Multimodal Sequencecited by 14
- 2025Shot-by-Shot: Film-Grammar-Aware Training-Free Audio Description Generationcited by 13
- 2024Long Story Short: Story-level Video Understanding from 20K Short Filmscited by 12
- 2024DistinctAD: Distinctive Audio Description Generation in Contextscited by 12
- 2018From Trailers to Storylines: An Efficient Way to Learn from Moviescited by 10
- 2024FunnyNet-W: Multimodal Learning of Funny Moments in Videos in the Wildcited by 9
- 2025StandUp4AI: A New Multilingual Dataset for Humor Detection in Stand-up Comedy Videoscited by 9
- 2025VideoLLM Benchmarks and Evaluation: A Surveycited by 6
- 2025Cin'easte: A Fine-grained Contextual Movie Question Answering Benchmarkcited by 2
- 2026MTLLFM: Multimodal-Temporal Laughter Localization: UR-FUNNY-Temporal and SMILE-Temporal Benchmarks with an Adaptive Multimodal Fusion Modelcited by 2
- 2026CineCap: Structured Reasoning with Spatio-Temporal Anchors for Cinematographic Video Captioningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models
- 2024Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies
- 2025Bridging Your Imagination with Audio-Video Generation via a Unified Director
- 2025RefineShot: Rethinking Cinematography Understanding with Foundational Skill Evaluation
- 2025MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mind
- 2025Movie Facts and Fibs (MF2): A Benchmark for Long Movie Understanding
- 2026MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs
- 2026Semantic visually-guided acoustic highlighting with large vision-language models