MovieTeller: Tool-augmented Movie Synopsis with ID Consistent Progressive Abstraction
Not on the map. Why?
Abstract (arXiv)
With the explosive growth of digital entertainment, automated video summarization has become indispensable for applications such as content indexing, personalized recommendation, and efficient media archiving. Automatic synopsis generation for long-form videos, such as movies and TV series, presents a significant challenge for existing Vision-Language Models (VLMs). While proficient at single-image captioning, these general-purpose models often exhibit critical failures in long-duration contexts, primarily a lack of ID-consistent character identification and a fractured narrative coherence. To overcome these limitations, we propose MovieTeller, a novel framework for generating movie synopses via tool-augmented progressive abstraction. Our core contribution is a training-free, tool-augmented, fact-grounded generation process. Instead of requiring costly model fine-tuning, our framework directly leverages off-the-shelf models in a plug-and-play manner. We first invoke a specialized face recognition model as an external "tool" to establish Factual Groundings--precise character identities and their corresponding bounding boxes. These groundings are then injected into the prompt to steer the VLM's reasoning, ensuring the generated scene descriptions are anchored to verifiable facts. Furthermore, our progressive abstraction pipeline decomposes the summarization of a full-length movie into a multi-stage process, effectively mitigating the context length limitations of current VLMs. Experiments demonstrate that our approach yields significant improvements in factual accuracy, character consistency, and overall narrative coherence compared to end-to-end baselines.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
16 of 26 references.
References · 16
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2024V2Xum-LLM: Cross-Modal Video Summarization with Temporal Prompt Instruction Tuningcited by 45
- 2021Masked Face Recognition Challenge: The InsightFace Track Reportcited by 41
4 more
- 2025AgentThink: A Unified Framework for Tool-Augmented Chain-of-Thought Reasoning in Vision-Language Models for Autonomous Drivingcited by 35
- 2025WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learningcited by 21
- 2024StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identificationcited by 13
- 2024ChatHuman: Chatting about 3D Humans with Toolscited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description
- 2024Movie101v2: Improved Movie Narration Benchmark
- 2025Minimal Clips, Maximum Salience: Long Video Summarization via Key Moment Extraction
- 2025Integrating Video and Text: A Balanced Approach to Multimodal Summary Generation and Evaluation
- 2026Beyond Anonymous Captions: Grounding Character Identity in Video Captioning and Question Answering
- 2024Realizing Video Summarization from the Path of Language-based Semantic Understanding
- 2024MovieBench: A Hierarchical Movie Level Dataset for Long Video Generation
- 2024Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies