Video Summarization Using Fully Convolutional Sequence Networks
Not on the map. Why?
Abstract (arXiv)
This paper addresses the problem of video summarization. Given an input video, the goal is to select a subset of the frames to create a summary video that optimally captures the important information of the input video. With the large amount of videos available online, video summarization provides a useful tool that assists video search, retrieval, browsing, etc. In this paper, we formulate video summarization as a sequence labeling problem. Unlike existing approaches that use recurrent models, we propose fully convolutional sequence models to solve video summarization. We firstly establish a novel connection between semantic segmentation and video summarization, and then adapt popular semantic segmentation networks for video summarization. Extensive experiments and analysis on two benchmark datasets demonstrate the effectiveness of our models.
Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 12; 2023: 16; 2024: 12; 2025: 12; 2026: 2.
71 papers.
Sort:
By area:
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2021CLIP-It! Language-Guided Video Summarizationcited by 99
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 83
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
- 2021Deep Reinforcement Learning in Computer Vision: A Comprehensive Surveycited by 43
- 2023VideoXum: Cross-modal Visual and Textural Summarization of Videoscited by 41
- 2024AMEGO: Active Memory from long EGOcentric videoscited by 36
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
- 2021Reconstructive Sequence-Graph Network for Video Summarizationcited by 34
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
- 2021Video Summarization through Reinforcement Learning with a 3D Spatio-Temporal U-Netcited by 22
38 more
- 2022Progressive Video Summarization via Multimodal Self-supervised Learningcited by 21
- 2024Saliency-Guided DETR for Moment Retrieval and Highlight Detectioncited by 21
- 2021Hierarchical Multimodal Transformer to Summarize Videoscited by 19
- 2021Learning Triadic Belief Dynamics in Nonverbal Communication from Videoscited by 17
- 2021UnweaveNet: Unweaving Activity Storiescited by 14
- 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
- 2021Video Joint Modelling Based on Hierarchical Transformer for Co-summarizationcited by 10
- 2024Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Groundingcited by 10
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learningcited by 10
- 2023Learning Segment Similarity and Alignment in Large-Scale Content Based Video Retrievalcited by 9
- 2024Towards Automated Movie Trailer Generationcited by 9
- 2021DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarizationcited by 8
- 2023Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understandingcited by 7
- 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detectioncited by 6
- 2022Video Summarization Overviewcited by 6
- 2023Conditional Modeling Based Automatic Video Summarizationcited by 6
- 2024Cluster-based Video Summarization with Temporal Context Awarenesscited by 6
- 2024Unsupervised Video Highlight Detection by Learning from Audio and Visual Recurrencecited by 6
- 2025Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videoscited by 6
- 2021AudioVisual Video Summarizationcited by 5
- 2022Contrastive Losses Are Natural Criteria for Unsupervised Video Summarizationcited by 5
- 2023VVS: Video-to-Video Retrieval with Irrelevant Frame Suppressioncited by 5
- 2025Spiking Variational Graph Representation Inference for Video Summarizationcited by 5
- 2022Multimodal Frame-Scoring Transformer for Video Summarizationcited by 4
- 2021Use of Affective Visual Information for Summarization of Human-Centric Videoscited by 3
- 2021ERA: Entity Relationship Aware Video Summarization with Wasserstein GANcited by 3
- 2021HighlightMe: Detecting Highlights from Human-Centric Videoscited by 3
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Modelscited by 3
- 2025Language-Guided Graph Representation Learning for Video Summarizationcited by 3
- 2022MHSCNet: A Multimodal Hierarchical Shot-aware Convolutional Network for Video Summarizationcited by 2
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attentioncited by 2
- 2023Masked Autoencoder for Unsupervised Video Summarizationcited by 2
- 2023Does Video Summarization Require Videos? Quantifying the Effectiveness of Language in Video Summarizationcited by 2
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Miningcited by 2
- 2025TRIM: A Self-Supervised Video Summarization Framework Maximizing Temporal Relative Information and Representativenesscited by 2
- 2026MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understandingcited by 2
- 2022Exploring Global Diversity and Local Context for Video Summarizationcited by 1
- 2022A Multi-stage deep architecture for summary generation of soccer videoscited by 1
50 most cited of 71 All 71 (JSON)
- 2026Zero-shot video highlight detection based on text descriptions and synthetic images13 Sep 2026
- 2026MMViR: A Multi-Modal and Multi-Granularity Representation for Long-range Video Understanding9 Jan 2026
- 2025ImagineNav++: Prompting Vision-Language Models as Embodied Navigator through Scene Imagination19 Dec 2025
- 2025Language-Guided Graph Representation Learning for Video Summarization14 Nov 2025
- 2025Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarization6 Sep 2025
- 2025Spiking Variational Graph Representation Inference for Video Summarization21 Aug 2025
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learning16 Jul 2025
- 2025Towards an Automated Multimodal Approach for Video Summarization: Building a Bridge Between Text, Audio and Facial Cue-Based Summarization30 Jun 2025
- 2025TRIM: A Self-Supervised Video Summarization Framework Maximizing Temporal Relative Information and Representativeness25 Jun 2025
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Models12 Jun 2025
- 2025MF2Summ: Multimodal Fusion for Video Summarization with Temporal Alignment12 Jun 2025
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Mining10 May 2025
38 more
- 2025Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videos21 Jan 2025
- 2025FullTransNet: Full Transformer with Local-Global Attention for Video Summarization1 Jan 2025
- 2024Switch-a-View: View Selection Learned from Unlabeled In-the-wild Videos24 Dec 2024
- 2024Video Summarization using Denoising Diffusion Probabilistic Model11 Dec 2024
- 2024Your Interest, Your Summaries: Query-Focused Long Video Summarization17 Oct 2024
- 2024Does SpatioTemporal information benefit Two video summarization benchmarks?4 Oct 2024
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Models4 Oct 2024
- 2024Saliency-Guided DETR for Moment Retrieval and Highlight Detection2 Oct 2024
- 2024EDSNet: Efficient-DSNet for Video Summarization23 Sep 2024
- 2024AMEGO: Active Memory from long EGOcentric videos17 Sep 2024
- 2024Unsupervised Video Highlight Detection by Learning from Audio and Visual Recurrence18 Jul 2024
- 2024Cluster-based Video Summarization with Temporal Context Awareness6 Apr 2024
- 2024Towards Automated Movie Trailer Generation4 Apr 2024
- 2024Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding18 Mar 2024
- 2023Facilitating the Production of Well-tailored Video Summaries for Sharing on Social Media5 Dec 2023
- 2023Scene Summarization: Clustering Scene Videos into Spatially Diverse Frames28 Nov 2023
- 2023Conditional Modeling Based Automatic Video Summarization20 Nov 2023
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding15 Nov 2023
- 2023Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding20 Sep 2023
- 2023Learning Segment Similarity and Alignment in Large-Scale Content Based Video Retrieval20 Sep 2023
- 2023Does Video Summarization Require Videos? Quantifying the Effectiveness of Language in Video Summarization18 Sep 2023
- 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos7 Jun 2023
- 2023Masked Autoencoder for Unsupervised Video Summarization2 Jun 2023
- 2023Motion-Based Sign Language Video Summarization using Curvature and Torsion26 May 2023
- 2023SELF-VS: Self-supervised Encoding Learning For Video Summarization28 Mar 2023
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detection24 Mar 2023
- 2023VideoXum: Cross-modal Visual and Textural Summarization of Videos21 Mar 2023
- 2023VVS: Video-to-Video Retrieval with Irrelevant Frame Suppression15 Mar 2023
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Losses13 Mar 2023
- 2023Learning to Summarize Videos by Contrasting Clips12 Jan 2023
- 2022Role of Audio in Audio-Visual Video Summarization2 Dec 2022
- 2022Contrastive Losses Are Natural Criteria for Unsupervised Video Summarization18 Nov 2022
- 2022Video Summarization Overview21 Oct 2022
- 2022Visualizing the Passage of Time with Video Temporal Pyramids25 Aug 2022
- 2022Visual Subtitle Feature Enhanced Video Outline Generation24 Aug 2022
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency14 Aug 2022
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attention18 Jul 2022
- 2022Multimodal Frame-Scoring Transformer for Video Summarization5 Jul 2022
50 newest of 71 All 71 (JSON)
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2021CLIP-It! Language-Guided Video Summarizationcited by 99
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 83
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
- 2021Deep Reinforcement Learning in Computer Vision: A Comprehensive Surveycited by 43
- 2023VideoXum: Cross-modal Visual and Textural Summarization of Videoscited by 41
- 2024AMEGO: Active Memory from long EGOcentric videoscited by 36
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
- 2021Reconstructive Sequence-Graph Network for Video Summarizationcited by 34
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
- 2021Video Summarization through Reinforcement Learning with a 3D Spatio-Temporal U-Netcited by 22
12 most cited of 67 All 67 (JSON)
- 2025Language-Guided Graph Representation Learning for Video Summarization14 Nov 2025
- 2025Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarization6 Sep 2025
- 2025Spiking Variational Graph Representation Inference for Video Summarization21 Aug 2025
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learning16 Jul 2025
- 2025Towards an Automated Multimodal Approach for Video Summarization: Building a Bridge Between Text, Audio and Facial Cue-Based Summarization30 Jun 2025
- 2025TRIM: A Self-Supervised Video Summarization Framework Maximizing Temporal Relative Information and Representativeness25 Jun 2025
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Models12 Jun 2025
- 2025MF2Summ: Multimodal Fusion for Video Summarization with Temporal Alignment12 Jun 2025
- 2025Weakly Supervised Temporal Sentence Grounding via Positive Sample Mining10 May 2025
- 2025Memory Storyboard: Leveraging Temporal Segmentation for Streaming Self-Supervised Learning from Egocentric Videos21 Jan 2025
- 2025FullTransNet: Full Transformer with Local-Global Attention for Video Summarization1 Jan 2025
- 2024Switch-a-View: View Selection Learned from Unlabeled In-the-wild Videos24 Dec 2024
12 newest of 67 All 67 (JSON)