mlsanityData to 14 Oct 2026

Movie Box Office Prediction With Self-Supervised and Visually Grounded Pretraining

arXiv 2304.10311 ↗First posted 20 Apr 2023cs.MM cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Investments in movie production are associated with a high level of risk as movie revenues have long-tailed and bimodal distributions. Accurate prediction of box-office revenue may mitigate the uncertainty and encourage investment. However, learning effective representations for actors, directors, and user-generated content-related keywords remains a challenging open problem. In this work, we investigate the effects of self-supervised pretraining and propose visual grounding of content keywords in objects from movie posters as a pertaining objective. Experiments on a large dataset of 35,794 movies demonstrate significant benefits of self-supervised training and visual grounding. In particular, visual grounding pretraining substantially improves learning on movies with content keywords and achieves 14.5% relative performance gains compared to a finetuned BERT model with identical architecture.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 46 references that are in the map. First posted on arXiv 20 Apr 2023.

Builds on

19 of 46 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2017Mask R-CNNcited by 7,277
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  6. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  7. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  8. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  9. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 507
  10. 2020Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformerscited by 288
  11. 2020Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervisioncited by 94
  12. 2022Things not Written in Text: Exploring Spatial Commonsense from Visual Signalscited by 41
7 more
  1. 2020Generative Imagination Elevates Machine Translationcited by 22
  2. 2022Imagination-Augmented Natural Language Understandingcited by 19
  3. 2022Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imaginationcited by 18
  4. 2021NumGPT: Improving Numeracy Ability of Generative Pre-trained Modelscited by 15
  5. 2015Early Predictions of Movie Success: the Who, What, and When of Profitabilitycited by 4
  6. 2021Initialization Matters: Regularizing Manifold-informed Initialization for Neural Recommendation Systemscited by 4
  7. 2017Predicting Personality from Book Preferences with User-Generated Content Labelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.