Cut to the Chase: Training-free Multimodal Summarization via Chain-of-Events
Not on the map. Why?
Abstract (arXiv)
Multimodal Summarization (MMS) aims to generate concise textual summaries by understanding and integrating information across videos, transcripts, and images. However, existing approaches still suffer from three main challenges: (1) reliance on domain-specific supervision, (2) implicit fusion with weak cross-modal grounding, and (3) flat temporal modeling without event transitions. To address these issues, we introduce **CoE**, a training-free MMS framework that performs structured reasoning through a **Chain-of-Events** guided by a Hierarchical Event Graph (HEG). The HEG encodes textual semantics into an explicit event hierarchy that scaffolds cross-modal grounding and temporal reasoning. Guided by this structure, **CoE** localizes key visual cues, models event evolution and causal transitions, and refines outputs via lightweight style adaptation for domain alignment. Extensive experiments on eight diverse datasets demonstrate that **CoE** consistently outperforms state-of-the-art video CoT baselines, achieving average gains of **+3.04 ROUGE**, **+9.51 CIDEr**, and **+1.88 BERTScore**, highlighting its robustness, interpretability, and cross-domain generalization. Our code is available at https://github.com/youxiaoxing/CoE.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 45 of its 60 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
45 of 60 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
33 more
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
- 2024Long Context Transfer from Language to Visioncited by 502
- 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
- 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 151
- 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
- 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 116
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 66
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 64
- 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
- 2020VMSMO: Learning to Generate Multimodal Summary for Video-based News Articlescited by 44
- 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 36
- 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Toolcited by 35
- 2023The Role of Chain-of-Thought in Complex Vision-Language Reasoning Taskcited by 32
- 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoningcited by 32
- 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMscited by 29
- 2025CoS: Chain-of-Shot Prompting for Long Video Understandingcited by 27
- 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Framescited by 27
- 2025ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Modelscited by 18
- 2025SiLVR: A Simple Language-based Video Reasoning Frameworkcited by 14
- 2022Hierarchical3D Adapters for Long Video-to-text Summarizationcited by 12
- 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
- 2024CaRDiff: Video Salient Object Ranking Chain of Thought Reasoning for Saliency Prediction with Diffusioncited by 12
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
- 2022TLDW: Extreme Multimodal Summarisation of News Videoscited by 3
- 2025HierSum: A Global and Local Attention Mechanism for Video Summarizationcited by 3
- 2025Video-Skill-CoT: Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoningcited by 3
- 2025CoTasks: Chain-of-Thought based Video Instruction Tuning Taskscited by 3
- 2024SITransformer: Shared Information-Guided Transformer for Extreme Multimodal Summarizationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Multimodal Language Models for Domain-Specific Procedural Video Summarization
- 2026HAVEN: Hierarchically Aligned Multimodal Benchmark for Unified Video Understanding
- 2026LVSum: A Benchmark for Timestamp-Aware Long Video Summarization
- 2021UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation
- 2024Generating Event-oriented Attribution for Movies via Two-Stage Prefix-Enhanced Multimodal LLM
- 2025Summarization of Multimodal Presentations with Vision-Language Models: Study of the Effect of Modalities and Structure
- 2026MMLDSum-LLM: Multimodal Long-Document Summarization with Visual-Alignment and Keyword-Aware
- 2026A Systematic Evaluation of Positional Bias in Multi-Video Summarization with MLLMs