mlsanityData to 7 Oct 2026

ECP-Bench: Benchmarking and Learning Entertainment Content Promotion with Foundation Models

arXiv 2609.22150 ↗First posted 26 Aug 2026cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Content promotion spans a broad set of skills, from understanding content to forecasting its market reception. However, LLMs' ability to support such promotion decisions remains underexplored. Existing studies are often limited to a single task (e.g., popularity prediction) or a small set of tasks within a single domain (e.g., movies). As a result, there is a lack of understanding of LLMs' abilities in the full promotion process and how these abilities generalize across different tasks and domains. In this work, we introduce ECP-Bench, a benchmark containing 1.9M movie, game, and music items and 423,451 questions across 33 tasks in five content-promotion skill families. Our evaluation shows that frontier models achieve only 51.9% overall accuracy and lose much of their advantage on post-cutoff content, with drops of up to 19.1 percentage points. In contrast, open-weight models fine-tuned on ECP-Bench achieve up to 60.3%, remain substantially more stable across the knowledge cutoff, generalize to unseen content and tasks, and exhibit meaningful cross-domain generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

21 of 34 references.

References · 21

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  4. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  5. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  6. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 396
  7. 2023A Survey on Large Language Models for Recommendationcited by 378
  8. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 336
  9. 2024FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIcited by 227
  10. 2024Bridging Language and Items for Retrieval and Recommendation: Benchmarking LLMs as Semantic Encoderscited by 213
  11. 2026Gemma 4 Technical Reportcited by 187
  12. 2024ChatMusician: Understanding and Generating Music Intrinsically with LLMcited by 67
9 more
  1. 2023Data Contamination Through the Lens of Timecited by 39
  2. 2025SMTPD: A New Benchmark for Temporal Prediction of Social Media Popularitycited by 4
  3. 2019Personalized Multimedia Item and Key Frame Recommendationcited by 3
  4. 2022Improving Transfer Learning with a Dual Image and Video Transformer for Multi-label Movie Trailer Genre Classificationcited by 3
  5. 2024PlayMyData: a curated dataset of multi-platform video gamescited by 2
  6. 2026Following the TRAIL: Predicting and Explaining Tomorrow's Hits with a Fine-Tuned LLMcited by 2
  7. 2023Movie Box Office Prediction With Self-Supervised and Visually Grounded Pretrainingcited by 1
  8. 2025Identifying Prompted Artist Names from Generated Imagescited by 1
  9. 2026Netflix Artwork Personalization via LLM Post-trainingcited by 1

Built on by

Not cited yet.