mlsanityData to 7 Oct 2026

Creating Multimedia Summaries Using Tweets and Videos

arXiv 2203.08931 ↗First posted 16 Mar 2022cs.CL cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

While popular televised events such as presidential debates or TV shows are airing, people provide commentary on them in real-time. In this paper, we propose a simple yet effective approach to combine social media commentary and videos to create a multimedia summary of televised events. Our approach identifies scenes from these events based on spikes of mentions of people involved in the event and automatically selects tweets and frames from the videos that occur during the time period of the spike that talk about and show the people being discussed.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 52 references that are in the map. First posted on arXiv 16 Mar 2022.

Builds on

16 of 52 references.

References · 16

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  4. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  5. 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 604
  6. 2015Learning Visual Features from Large Weakly Supervised Datacited by 165
  7. 2016Video Summarization with Long Short-term Memorycited by 142
  8. 2019A Discrete Hard EM Approach for Weakly Supervised Question Answeringcited by 78
  9. 2018From Benedict Cumberbatch to Sherlock Holmes: Character Identification in TV series without a Scriptcited by 20
  10. 2020Event detection in coarsely annotated sports videos via parallel multi receptive field 1D convolutionscited by 18
  11. 2017Generating Descriptions with Grounded and Co-Referenced Peoplecited by 15
  12. 2019Self-Supervised Learning of Face Representations for Video Face Clusteringcited by 11
4 more
  1. 2017Learning from Video and Text via Large-Scale Discriminative Clusteringcited by 6
  2. 2019Sub-event detection from Twitter streams as a sequence labeling problemcited by 5
  3. 2018Speaker Naming in Moviescited by 3
  4. 2020Decoupling Video and Human Motion: Towards Practical Event Detection in Athlete Recordingscited by 2

Built on by

Not cited yet.