# Using Saliency and Cropping to Improve Video Memorability

arXiv: https://arxiv.org/abs/2309.11881 · HTML: https://mlsanity.com/paper/2309.11881/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 17 of its 25 references that are in the map.
- First posted on arXiv 21 Sep 2023.

## Builds on (most cited first, 17 of 17)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [Deep Video Inpainting](https://mlsanity.com/paper/1905.01639/) (2019)
- [Predicting Human Eye Fixations via an LSTM-based Saliency Attentive Model](https://mlsanity.com/paper/1611.09571/) (2016)
- [Learning Trajectory-Aware Transformer for Video Super-Resolution](https://mlsanity.com/paper/2204.04216/) (2022)
- [Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNet](https://mlsanity.com/paper/1411.1045/) (2014)
- [Review of Visual Saliency Detection with Comprehensive Information](https://mlsanity.com/paper/1803.03391/) (2018)
- [DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modeling](https://mlsanity.com/paper/2105.12441/) (2021)
- [VideoMem: Constructing, Analyzing, Predicting Short-term and Long-term Video Memorability](https://mlsanity.com/paper/1812.01973/) (2018)
- [Multimodal Memorability: Modeling Effects of Semantics and Decay on Video Memorability](https://mlsanity.com/paper/2009.02568/) (2020)
- [Overview of MediaEval 2020 Predicting Media Memorability Task: What Makes a Video Memorable?](https://mlsanity.com/paper/2012.15650/) (2020)
- [Leveraging Audio Gestalt to Predict Media Memorability](https://mlsanity.com/paper/2012.15635/) (2020)
- [The Influence of Audio on Video Memorability with an Audio Gestalt Regulated Video Memorability System](https://mlsanity.com/paper/2104.11568/) (2021)
- [Overview of The MediaEval 2021 Predicting Media Memorability Task](https://mlsanity.com/paper/2112.05982/) (2021)
- [Overview of The MediaEval 2022 Predicting Video Memorability Task](https://mlsanity.com/paper/2212.06516/) (2022)
- [Diffusing Surrogate Dreams of Video Scenes to Predict Video Memorability](https://mlsanity.com/paper/2212.09308/) (2022)
- [Predicting Media Memorability: Comparing Visual, Textual and Auditory Features](https://mlsanity.com/paper/2112.07969/) (2021)
- [Analysing the Memorability of a Procedural Crime-Drama TV Series, CSI](https://mlsanity.com/paper/2208.03479/) (2022)

## Abstract (arXiv)

Video memorability is a measure of how likely a particular video is to be remembered by a viewer when that viewer has no emotional connection with the video content. It is an important characteristic as videos that are more memorable are more likely to be shared, viewed, and discussed. This paper presents results of a series of experiments where we improved the memorability of a video by selectively cropping frames based on image saliency. We present results of a basic fixed cropping as well as the results from dynamic cropping where both the size of the crop and the position of the crop within the frame, move as the video is played and saliency is tracked. Our results indicate that especially for videos of low initial memorability, the memorability score can be improved.