mlsanityData to 7 Oct 2026

Cut to the Chase: Training-free Multimodal Summarization via Chain-of-Events

arXiv 2603.06213 ↗First posted 6 Mar 2026cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Multimodal Summarization (MMS) aims to generate concise textual summaries by understanding and integrating information across videos, transcripts, and images. However, existing approaches still suffer from three main challenges: (1) reliance on domain-specific supervision, (2) implicit fusion with weak cross-modal grounding, and (3) flat temporal modeling without event transitions. To address these issues, we introduce **CoE**, a training-free MMS framework that performs structured reasoning through a **Chain-of-Events** guided by a Hierarchical Event Graph (HEG). The HEG encodes textual semantics into an explicit event hierarchy that scaffolds cross-modal grounding and temporal reasoning. Guided by this structure, **CoE** localizes key visual cues, models event evolution and causal transitions, and refines outputs via lightweight style adaptation for domain alignment. Extensive experiments on eight diverse datasets demonstrate that **CoE** consistently outperforms state-of-the-art video CoT baselines, achieving average gains of **+3.04 ROUGE**, **+9.51 CIDEr**, and **+1.88 BERTScore**, highlighting its robustness, interpretability, and cross-domain generalization. Our code is available at https://github.com/youxiaoxing/CoE.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 45 of its 60 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

45 of 60 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  9. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  10. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  11. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  12. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
33 more
  1. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  2. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  3. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
  4. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  5. 2024Long Context Transfer from Language to Visioncited by 502
  6. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  7. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 151
  8. 2018How2: A Large-scale Dataset for Multimodal Language Understandingcited by 137
  9. 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 116
  10. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  11. 2025V-STaR: Benchmarking Video-LLMs on Video Spatio-Temporal Reasoningcited by 66
  12. 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
  13. 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 64
  14. 2023SoccerNet-Caption: Dense Video Captioning for Soccer Broadcasts Commentariescited by 57
  15. 2020VMSMO: Learning to Generate Multimodal Summary for Video-based News Articlescited by 44
  16. 2025Chain-of-Frames: Advancing Video Understanding in Multimodal LLMs via Frame-Aware Reasoningcited by 36
  17. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Toolcited by 35
  18. 2023The Role of Chain-of-Thought in Complex Vision-Language Reasoning Taskcited by 32
  19. 2025VideoChat-A1: Thinking with Long Videos by Chain-of-Shot Reasoningcited by 32
  20. 2024VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMscited by 29
  21. 2025CoS: Chain-of-Shot Prompting for Long Video Understandingcited by 27
  22. 2025Temporal Chain of Thought: Long-Video Understanding by Thinking in Framescited by 27
  23. 2025ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Modelscited by 18
  24. 2025SiLVR: A Simple Language-based Video Reasoning Frameworkcited by 14
  25. 2022Hierarchical3D Adapters for Long Video-to-text Summarizationcited by 12
  26. 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
  27. 2024CaRDiff: Video Salient Object Ranking Chain of Thought Reasoning for Saliency Prediction with Diffusioncited by 12
  28. 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
  29. 2022TLDW: Extreme Multimodal Summarisation of News Videoscited by 3
  30. 2025HierSum: A Global and Local Attention Mechanism for Video Summarizationcited by 3
  31. 2025Video-Skill-CoT: Skill-based Chain-of-Thoughts for Domain-Adaptive Video Reasoningcited by 3
  32. 2025CoTasks: Chain-of-Thought based Video Instruction Tuning Taskscited by 3
  33. 2024SITransformer: Shared Information-Guided Transformer for Extreme Multimodal Summarizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Multimodal Language Models for Domain-Specific Procedural Video Summarization
  2. 2026HAVEN: Hierarchically Aligned Multimodal Benchmark for Unified Video Understanding
  3. 2026LVSum: A Benchmark for Timestamp-Aware Long Video Summarization
  4. 2021UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation
  5. 2024Generating Event-oriented Attribution for Movies via Two-Stage Prefix-Enhanced Multimodal LLM
  6. 2025Summarization of Multimodal Presentations with Vision-Language Models: Study of the Effect of Modalities and Structure
  7. 2026MMLDSum-LLM: Multimodal Long-Document Summarization with Visual-Alignment and Keyword-Aware
  8. 2026A Systematic Evaluation of Positional Bias in Multi-Video Summarization with MLLMs