Video2GIF: Automatic Generation of Animated GIFs from Video
Not on the map. Why?
Abstract (arXiv)
We introduce the novel problem of automatically generating animated GIFs from video. GIFs are short looping video with no sound, and a perfect combination between image and video that really capture our attention. GIFs tell a story, express emotion, turn events into humorous moments, and are the new wave of photojournalism. We pose the question: Can we automate the entirely manual and elaborate process of GIF creation by leveraging the plethora of user generated GIF content? We propose a Robust Deep RankNet that, given a video, generates a ranked list of its segments according to their suitability as GIF. We train our model to learn what visual content is often selected for GIFs by using over 100K user generated GIFs and their corresponding video sources. We effectively deal with the noisy web data by proposing a novel adaptive Huber loss in the ranking formulation. We show that our approach is robust to outliers and picks up several patterns that are frequently present in popular animated GIFs. On our new large-scale benchmark dataset, we show the advantage of our approach over several state-of-the-art methods.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 May 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 7; 2024: 10; 2025: 6; 2026: 6.
41 papers.
Sort:
By area:
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2021Cross-category Video Highlight Detection via Set-based Learningcited by 38
- 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Groundingcited by 34
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
- 2024Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrievalcited by 30
- 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Groundingcited by 23
- 2024Saliency-Guided DETR for Moment Retrieval and Highlight Detectioncited by 21
- 2024Multimodal Action Quality Assessmentcited by 20
- 2022Learning Pixel-Level Distinctions for Video Highlight Detectioncited by 16
29 more
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learningcited by 10
- 2022Probing Visual-Audio Representation for Video Highlight Detection via Hard-Pairs Guided Contrastive Learningcited by 9
- 2021AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistantcited by 8
- 2025LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detectioncited by 8
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learningcited by 7
- 2025OmniSTVG: Toward Spatio-Temporal Omni-Object Video Groundingcited by 7
- 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detectioncited by 6
- 2022Video Summarization Overviewcited by 6
- 2024Unsupervised Video Highlight Detection by Learning from Audio and Visual Recurrencecited by 6
- 2023Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Moviescited by 4
- 2021HighlightMe: Detecting Highlights from Human-Centric Videoscited by 3
- 2023Unsupervised Video Summarization via Iterative Training and Simplified GANcited by 3
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attentioncited by 2
- 2023DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detectioncited by 2
- 2024ActPrompt: In-Domain Feature Adaptation via Action Cues for Video Temporal Groundingcited by 2
- 2025Test-Time Adaptation for Video Highlight Detection Using Meta-Auxiliary Learning and Cross-Modality Hallucinationscited by 2
- 2022Exploring Global Diversity and Local Context for Video Summarizationcited by 1
- 2022Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Priorcited by 1
- 2023A Challenging Multimodal Video Summary: Simultaneously Extracting and Generating Keyframe-Caption Pairs from Videocited by 1
- 2026CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detectioncited by 1
- 2024Reinforcement Learning for Unsupervised Video Summarization with Reward Generator Trainingcited by 0
- 2024D&M: Enriching E-commerce Videos with Sound Effects by Key Moment Detection and SFX Matchingcited by 0
- 2025Rhapsody: A Dataset for Highlight Detection in Podcastscited by 0
- 2025MLVTG: Mamba-Based Feature Alignment and LLM-Driven Purification for Multi-Modal Video Temporal Groundingcited by 0
- 2026SVHighlights: Towards Extremely Long Sport Video Highlight Detectioncited by 0
- 2026Autoregressive Modeling of Film with Applications in Video Montagecited by 0
- 2026TRINITY: A Multi-Perspective Benchmark for Personal-Style Video Highlight Detectioncited by 0
- 2026Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendationcited by 0
- 2026IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Groundingcited by 0
- 2026IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Grounding9 Sep 2026
- 2026Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation1 Sep 2026
- 2026TRINITY: A Multi-Perspective Benchmark for Personal-Style Video Highlight Detection30 Aug 2026
- 2026Autoregressive Modeling of Film with Applications in Video Montage16 Jul 2026
- 2026SVHighlights: Towards Extremely Long Sport Video Highlight Detection5 Jun 2026
- 2026CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection31 May 2026
- 2025Test-Time Adaptation for Video Highlight Detection Using Meta-Auxiliary Learning and Cross-Modality Hallucinations6 Aug 2025
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learning16 Jul 2025
- 2025MLVTG: Mamba-Based Feature Alignment and LLM-Driven Purification for Multi-Modal Video Temporal Grounding10 Jun 2025
- 2025Rhapsody: A Dataset for Highlight Detection in Podcasts26 May 2025
- 2025OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding13 Mar 2025
- 2025LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection18 Jan 2025
29 more
- 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding18 Dec 2024
- 2024Saliency-Guided DETR for Moment Retrieval and Highlight Detection2 Oct 2024
- 2024D&M: Enriching E-commerce Videos with Sound Effects by Key Moment Detection and SFX Matching23 Aug 2024
- 2024ActPrompt: In-Domain Feature Adaptation via Action Cues for Video Temporal Grounding13 Aug 2024
- 2024Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval21 Jul 2024
- 2024Unsupervised Video Highlight Detection by Learning from Audio and Visual Recurrence18 Jul 2024
- 2024Reinforcement Learning for Unsupervised Video Summarization with Reward Generator Training5 Jul 2024
- 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding31 Mar 2024
- 2024Unsupervised Modality-Transferable Video Highlight Detection with Representation Activation Sequence Learning14 Mar 2024
- 2024Multimodal Action Quality Assessment31 Jan 2024
- 2023A Challenging Multimodal Video Summary: Simultaneously Extracting and Generating Keyframe-Caption Pairs from Video4 Dec 2023
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding15 Nov 2023
- 2023Unsupervised Video Summarization via Iterative Training and Simplified GAN7 Nov 2023
- 2023DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detection29 Aug 2023
- 2023UniVTG: Towards Unified Video-Language Temporal Grounding31 Jul 2023
- 2023Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies26 Mar 2023
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detection24 Mar 2023
- 2022Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior22 Nov 2022
- 2022Video Summarization Overview21 Oct 2022
- 2022Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attention18 Jul 2022
- 2022Probing Visual-Audio Representation for Video Highlight Detection via Hard-Pairs Guided Contrastive Learning21 Jun 2022
- 2022Learning Pixel-Level Distinctions for Video Highlight Detection10 Apr 2022
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection23 Mar 2022
- 2022Exploring Global Diversity and Local Context for Video Summarization27 Jan 2022
- 2021AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant30 Nov 2021
- 2021HighlightMe: Detecting Highlights from Human-Centric Videos5 Oct 2021
- 2021PR-Net: Preference Reasoning for Personalized Video Highlight Detection4 Sep 2021
- 2021Cross-category Video Highlight Detection via Set-based Learning26 Aug 2021
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries20 Jul 2021
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2022UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detectioncited by 148
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2021Cross-category Video Highlight Detection via Set-based Learningcited by 38
- 2024R2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Groundingcited by 34
- 2023Correlation-Guided Query-Dependency Calibration for Video Temporal Groundingcited by 31
- 2024Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrievalcited by 30
- 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Groundingcited by 23
- 2024Saliency-Guided DETR for Moment Retrieval and Highlight Detectioncited by 21
- 2024Multimodal Action Quality Assessmentcited by 20
- 2022Learning Pixel-Level Distinctions for Video Highlight Detectioncited by 16
12 most cited of 38 All 38 (JSON)
- 2026IAE-VTG: Interaction-Aligned Action-Entity Video Temporal Grounding9 Sep 2026
- 2026Does This Moment Justify the Recommendation? Counterfactual Behavior-Grounded Evidence Retrieval for Personalized Video Recommendation1 Sep 2026
- 2026TRINITY: A Multi-Perspective Benchmark for Personal-Style Video Highlight Detection30 Aug 2026
- 2026Autoregressive Modeling of Film with Applications in Video Montage16 Jul 2026
- 2026SVHighlights: Towards Extremely Long Sport Video Highlight Detection5 Jun 2026
- 2026CoSTL: Comprehensive Spatial-Temporal Representation Learning for Moment Retrieval and Highlight Detection31 May 2026
- 2025Test-Time Adaptation for Video Highlight Detection Using Meta-Auxiliary Learning and Cross-Modality Hallucinations6 Aug 2025
- 2025MS-DETR: Towards Effective Video Moment Retrieval and Highlight Detection by Joint Motion-Semantic Learning16 Jul 2025
- 2025Rhapsody: A Dataset for Highlight Detection in Podcasts26 May 2025
- 2025OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding13 Mar 2025
- 2025LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection18 Jan 2025
- 2024FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding18 Dec 2024
12 newest of 38 All 38 (JSON)