Query-Focused Extractive Video Summarization
Not on the map. Why?
Abstract (arXiv)
Video data is explosively growing. As a result of the "big video data", intelligent algorithms for automatic video summarization have re-emerged as a pressing need. We develop a probabilistic model, Sequential and Hierarchical Determinantal Point Process (SH-DPP), for query-focused extractive video summarization. Given a user query and a long video sequence, our algorithm returns a summary by selecting key shots from the video. The decision to include a shot in the summary depends on the shot's relevance to the user query and importance in the context of the video, jointly. We verify our approach on two densely annotated video datasets. The query-focused video summarization is particularly useful for search engines, e.g., to display snippets of videos.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 2; 2024: 4; 2025: 7; 2026: 1.
26 papers.
Sort:
By area:
- 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
- 2021CLIP-It! Language-Guided Video Summarizationcited by 99
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2021PRISM: A Rich Class of Parameterized Submodular Information Measures for Guided Subset Selectioncited by 51
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 38
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
- 2024Scaling Up Video Summarization Pretraining with Large Language Modelscited by 17
- 2021DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarizationcited by 8
- 2022DNS: Determinantal Point Process Based Neural Network Sampler for Ensemble Reinforcement Learningcited by 8
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learningcited by 7
- 2021How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarizationcited by 6
14 more
- 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detectioncited by 6
- 2022Video Summarization Overviewcited by 6
- 2025Spiking Variational Graph Representation Inference for Video Summarizationcited by 5
- 2022Multimodal Frame-Scoring Transformer for Video Summarizationcited by 4
- 2025SD-VSum: A Method and Dataset for Script-Driven Video Summarizationcited by 3
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Modelscited by 3
- 2025Language-Guided Graph Representation Learning for Video Summarizationcited by 3
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attentioncited by 2
- 2024Your Interest, Your Summaries: Query-Focused Long Video Summarizationcited by 1
- 2025Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learningcited by 1
- 2024Query-centric Audio-Visual Cognition Network for Moment Retrieval, Segmentation and Step-Captioningcited by 0
- 2025Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarizationcited by 0
- 2025SD-MVSum: Script-Driven Multimodal Video Summarization Method and Datasetscited by 0
- 2026LVSum: A Benchmark for Timestamp-Aware Long Video Summarizationcited by 0
- 2026LVSum: A Benchmark for Timestamp-Aware Long Video Summarization11 Apr 2026
- 2025Language-Guided Graph Representation Learning for Video Summarization14 Nov 2025
- 2025Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning22 Oct 2025
- 2025SD-MVSum: Script-Driven Multimodal Video Summarization Method and Datasets7 Oct 2025
- 2025Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarization6 Sep 2025
- 2025Spiking Variational Graph Representation Inference for Video Summarization21 Aug 2025
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Models12 Jun 2025
- 2025SD-VSum: A Method and Dataset for Script-Driven Video Summarization6 May 2025
- 2024Query-centric Audio-Visual Cognition Network for Moment Retrieval, Segmentation and Step-Captioning18 Dec 2024
- 2024Your Interest, Your Summaries: Query-Focused Long Video Summarization17 Oct 2024
- 2024Scaling Up Video Summarization Pretraining with Large Language Models4 Apr 2024
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learning14 Mar 2024
14 more
- 2023An Outlook into the Future of Egocentric Vision14 Aug 2023
- 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone11 Jul 2023
- 2022Video Summarization Overview21 Oct 2022
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency14 Aug 2022
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attention18 Jul 2022
- 2022Multimodal Frame-Scoring Transformer for Video Summarization5 Jul 2022
- 2022Submodularity In Machine Learning and Artificial Intelligence31 Jan 2022
- 2022DNS: Determinantal Point Process Based Neural Network Sampler for Ensemble Reinforcement Learning31 Jan 2022
- 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detection4 Sep 2021
- 2021CLIP-It! Language-Guided Video Summarization1 Jul 2021
- 2021DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarization13 May 2021
- 2021PRISM: A Rich Class of Parameterized Submodular Information Measures for Guided Subset Selection27 Feb 2021
- 2021How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarization26 Jan 2021
- 2021Video Summarization Using Deep Neural Networks: A Survey15 Jan 2021
- 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
- 2021CLIP-It! Language-Guided Video Summarizationcited by 99
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2023An Outlook into the Future of Egocentric Visioncited by 84
- 2021PRISM: A Rich Class of Parameterized Submodular Information Measures for Guided Subset Selectioncited by 51
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 38
- 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
- 2024Scaling Up Video Summarization Pretraining with Large Language Modelscited by 17
- 2021DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarizationcited by 8
- 2022DNS: Determinantal Point Process Based Neural Network Sampler for Ensemble Reinforcement Learningcited by 8
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learningcited by 7
- 2021How Good is a Video Summary? A New Benchmarking Dataset and Evaluation Framework Towards Realistic Video Summarizationcited by 6
12 most cited of 25 All 25 (JSON)
- 2025Language-Guided Graph Representation Learning for Video Summarization14 Nov 2025
- 2025Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning22 Oct 2025
- 2025SD-MVSum: Script-Driven Multimodal Video Summarization Method and Datasets7 Oct 2025
- 2025Language-guided Recursive Spatiotemporal Graph Modeling for Video Summarization6 Sep 2025
- 2025Spiking Variational Graph Representation Inference for Video Summarization21 Aug 2025
- 2025Prompts to Summaries: Zero-Shot Language-Guided Video Summarization with Large Language and Video Models12 Jun 2025
- 2025SD-VSum: A Method and Dataset for Script-Driven Video Summarization6 May 2025
- 2024Query-centric Audio-Visual Cognition Network for Moment Retrieval, Segmentation and Step-Captioning18 Dec 2024
- 2024Your Interest, Your Summaries: Query-Focused Long Video Summarization17 Oct 2024
- 2024Scaling Up Video Summarization Pretraining with Large Language Models4 Apr 2024
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learning14 Mar 2024
- 2023An Outlook into the Future of Egocentric Vision14 Aug 2023
12 newest of 25 All 25 (JSON)