mlsanityData to 7 Oct 2026

Summarizing Videos with Attention

arXiv 1812.01969 ↗First posted 5 Dec 2018cs.CV cs.CL cs.LGcited by 69

Not on the map. Why?

Abstract (arXiv)

In this work we propose a novel method for supervised, keyshots based video summarization by applying a conceptually simple and computationally efficient soft, self-attention mechanism. Current state of the art methods leverage bi-directional recurrent networks such as BiLSTM combined with attention. These networks are complex to implement and computationally demanding compared to fully connected networks. To that end we propose a simple, self-attention based network for video summarization which performs the entire sequence to sequence transformation in a single feed forward pass and single backward pass during training. Our method sets a new state of the art results on two benchmarks TvSum and SumMe, commonly used in this domain.

Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 15; 2022: 13; 2023: 8; 2024: 14; 2025: 10; 2026: 9.

69 papers.

Sort:

By area:

  1. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  2. 2021CLIP-It! Language-Guided Video Summarizationcited by 99
  3. 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
  4. 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
  5. 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
  6. 2022Video Transformers: A Surveycited by 63
  7. 2024V2Xum-LLM: Cross-Modal Video Summarization with Temporal Prompt Instruction Tuningcited by 45
  8. 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
  9. 2021Reconstructive Sequence-Graph Network for Video Summarizationcited by 34
  10. 2021Supervised Video Summarization via Multiple Feature Sets with Parallel Attentioncited by 26
  11. 2021Learning Discriminative Prototypes with Dynamic Time Warpingcited by 23
  12. 2024CSTA: CNN-based Spatiotemporal Attention for Video Summarizationcited by 23
38 more
  1. 2022Progressive Video Summarization via Multimodal Self-supervised Learningcited by 21
  2. 2021Hierarchical Multimodal Transformer to Summarize Videoscited by 19
  3. 2021IntentVizor: Towards Generic Query Guided Interactive Video Summarizationcited by 18
  4. 2021TRECVID 2020: A comprehensive campaign for evaluating video retrieval tasks across multiple application domainscited by 16
  5. 2025Video Summarization with Large Language Modelscited by 16
  6. 2021Video Joint Modelling Based on Hierarchical Transformer for Co-summarizationcited by 10
  7. 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Rewardcited by 10
  8. 2024Towards Automated Movie Trailer Generationcited by 9
  9. 2023Causalainer: Causal Explainer for Automatic Video Summarizationcited by 8
  10. 2024Harnessing Business and Media Insights with Large Language Modelscited by 7
  11. 2021How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarizationcited by 6
  12. 2022Video Summarization Overviewcited by 6
  13. 2023Conditional Modeling Based Automatic Video Summarizationcited by 6
  14. 2024Cluster-based Video Summarization with Temporal Context Awarenesscited by 6
  15. 2024Unsupervised Video Highlight Detection by Learning from Audio and Visual Recurrencecited by 6
  16. 2021AudioVisual Video Summarizationcited by 5
  17. 2022Contrastive Losses Are Natural Criteria for Unsupervised Video Summarizationcited by 5
  18. 2022LTC-SUM: Lightweight Client-driven Personalized Video Summarization Framework Using 2D CNNcited by 4
  19. 2022Multimodal Frame-Scoring Transformer for Video Summarizationcited by 4
  20. 2024VideoSAGE: Video Summarization with Graph Representation Learningcited by 4
  21. 2025SummDiff: Generative Modeling of Video Summarization with Diffusioncited by 4
  22. 2021Use of Affective Visual Information for Summarization of Human-Centric Videoscited by 3
  23. 2022VRAG: Region Attention Graphs for Content-Based Video Retrievalcited by 3
  24. 2025HierSum: A Global and Local Attention Mechanism for Video Summarizationcited by 3
  25. 2022MHSCNet: A Multimodal Hierarchical Shot-aware Convolutional Network for Video Summarizationcited by 2
  26. 2023Masked Autoencoder for Unsupervised Video Summarizationcited by 2
  27. 2025MS-Temba: Multi-Scale Temporal Mamba for Understanding Long Untrimmed Videoscited by 2
  28. 2025TRIM: A Self-Supervised Video Summarization Framework Maximizing Temporal Relative Information and Representativenesscited by 2
  29. 2025Self-Paced and Self-Corrective Masked Prediction for Movie Trailer Generationcited by 2
  30. 2026TripleSumm: Adaptive Triple-Modality Fusion for Video Summarizationcited by 2
  31. 2021Audiovisual Highlight Detection in Videoscited by 1
  32. 2022Exploring Global Diversity and Local Context for Video Summarizationcited by 1
  33. 2022Exploring Domain Incremental Video Highlights Detection with the LiveFood Benchmarkcited by 1
  34. 2023Learning to Summarize Videos by Contrasting Clipscited by 1
  35. 2023Can we predict the Most Replayed data of video streaming platforms?cited by 1
  36. 2023Scene Summarization: Clustering Scene Videos into Spatially Diverse Framescited by 1
  37. 2024An Integrated Framework for Multi-Granular Explanation of Video Summarizationcited by 1
  38. 2024UBiSS: A Unified Framework for Bimodal Semantic Summarization of Videoscited by 1

50 most cited of 69 All 69 (JSON)