cs.IRAug 26, 2026

ECP-Bench: Benchmarking and Learning Entertainment Content Promotion with Foundation Models

Authors: Hyomin Kim, Bowen Chen, Jin Huang, Zhao Wang, Qiaozhu Mei, Shingo Takamatsu

Organizations: Sony Group Corporation · KAIST · University of Michigan

Abstract

Content promotion spans a broad set of skills, from understanding content to forecasting its market reception. However, LLMs' ability to support such promotion decisions remains underexplored. Existing studies are often limited to a single task (e.g., popularity prediction) or a small set of tasks within a single domain (e.g., movies). As a result, there is a lack of understanding of LLMs' abilities in the full promotion process and how these abilities generalize across different tasks and domains. In this work, we introduce ECP-Bench, a benchmark containing 1.9M movie, game, and music items and 423,451 questions across 33 tasks in five content-promotion skill families. Our evaluation shows that frontier models achieve only 51.9% overall accuracy and lose much of their advantage on post-cutoff content, with drops of up to 19.1 percentage points. In contrast, open-weight models fine-tuned on ECP-Bench achieve up to 60.3%, remain substantially more stable across the knowledge cutoff, generalize to unseen content and tasks, and exhibit meaningful cross-domain generalization.

Explore similar work

CardsList
  1. LCM-Promo: An LLM-Based Uplift Model for Promotion Allocation

    Oct 27, 2026Nesta Midavaine, Floris Fok, Paulo Mendes +4Uplift ModelingConversion Rate Prediction

  2. RPCBench: A Benchmark for Proactive Premise Critique in LLM-based Recommendation

    Sep 1, 2026Zhongru Chen, Yuan Wu, Yi ChangLLM EvaluationLarge Language Model-Based Recommendation

  3. E-Bench: Benchmarking Multi-Step Tool-Use Agents in Real-World Product Scenarios

    Jul 26, 2026Weihuang Zheng, Tianyuan Zou, Eileen Ye +5Computer-Use Agent BenchmarksTool-Use Evaluation