Graph Unfolding and Sampling for Transitory Video Keyframe Selection via Gershgorin Disc Alignment
Not on the map. Why?
Abstract (arXiv)
User-generated videos (UGVs) uploaded from mobile phones to social media sites like YouTube and TikTok are short and non-repetitive. We summarize a transitory UGV into several keyframes in linear-time via fast graph sampling based on Gershgorin disc alignment (GDA). Specifically, we first model a sequence of N frames in a UGV as an M-hop path graph cGo for M ll N, where the similarity between two frames within M time instants is encoded as a positive edge based on feature similarity. Towards efficient sampling, we then ``unfold'' cGo to a 1-hop path graph cG, specified by a generalized graph Laplacian matrix cL, via one of two graph unfolding procedures with provable performance bounds. We show that maximizing the smallest eigenvalue λmin(B) of a coefficient matrix B = diagh + μ cL, where h is the binary keyframe selection vector, is equivalent to minimizing a worst-case signal reconstruction error. We maximize instead the Gershgorin circle theorem (GCT) lower bound λ^-min(B) by choosing h via a new fast graph sampling algorithm that iteratively aligns left-ends of Gershgorin discs for all graph nodes (frames). Experiments on multiple short video datasets show that our algorithm achieves comparable or better keyframe selection performance compared to state-of-the-art methods, at a substantially reduced complexity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 80 references that are in the map. First posted on arXiv 3 Aug 2024.
Builds on
29 of 80 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2014Going Deeper with Convolutionscited by 4,241
- 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
- 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 413
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 406
- 2016Video Summarization with Long Short-term Memorycited by 142
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2018Summarizing Videos with Attentioncited by 69
- 2018Graph Spectral Image Processingcited by 42
17 more
- 2015Discrete Signal Processing on Graphs: Sampling Theorycited by 34
- 2021Supervised Video Summarization via Multiple Feature Sets with Parallel Attentioncited by 26
- 2024CSTA: CNN-based Spatiotemporal Attention for Video Summarizationcited by 23
- 2021Video Summarization through Reinforcement Learning with a 3D Spatio-Temporal U-Netcited by 22
- 2014Dissimilarity-based Sparse Subset Selectioncited by 19
- 2015Random sampling of bandlimited signals on graphscited by 15
- 2020Signed Graph Metric Learning via Gershgorin Disc Perfect Alignmentcited by 15
- 2020Convolutional Hierarchical Attention Network for Query-Focused Video Summarizationcited by 13
- 2016Random Walk Graph Laplacian based Smoothness Prior for Soft Decoding of JPEG Imagescited by 12
- 2019A General Framework for Edited Video and Raw Video Summarizationcited by 12
- 2024Shorts vs. Regular Videos on YouTube: A Comparative Analysis of User Engagement and Content Creation Trendscited by 11
- 2018Eigendecomposition-Free Sampling Set Selection for Graph Signalscited by 9
- 2019Fast Graph Sampling Set Selection Using Gershgorin Disc Alignmentcited by 8
- 2022Video Summarization Overviewcited by 6
- 2017Structured sampling and fast reconstruction of smooth graph signalscited by 3
- 2018A-Optimal Sampling and Robust Reconstruction for Graph Signals via Truncated Neumann Seriescited by 3
- 2021Fast Graph Sampling for Short Video Summarization using Gershgorin Disc Alignmentcited by 1
Built on by
Not cited yet.