cs.CVNov 18, 2026

EVF-Bench: A Comprehensive Benchmark for E-commerce Visual Effects in Video Generation

Authors: Run Ling, Ke Cao, Runze He, Jie Gao, Ao Ma, Wei Feng, Zhanjie Zhang, Hao Wang, 

Organizations: JD.com, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · Software College, Northeastern University, Shenyang, China

Abstract

E-commerce visual effects (EVF) are dynamic, product-centered visual presentations in e-commerce videos, often accompanied by promotional text. They play an important role in attracting viewer attention and conveying product information. However, general measures of visual quality and text relevance alone do not establish whether generated videos preserve product appearance, maintain readable text, and produce coherent, contextually appropriate effects. To address this issue, we introduce EVF-Bench, a dedicated benchmark spanning six evaluation dimensions: visual quality and text relevance as general dimensions, and motion, product consistency, text stability, and creative rationality as EVF-specific dimensions. To complement the benchmark and support task-aligned research and model adaptation, we further construct EVF-32K, a dataset of over 32000 curated image-text-video triples tailored to e-commerce scenarios. Using this suite, we systematically evaluate representative video generation models and their domain-adapted variants. The results reveal complementary strengths, with no evaluated configuration leading all six dimensions. Together, EVF-Bench and EVF-32K provide a task-oriented evaluation framework and a supporting data resource for e-commerce video generation.

Figures & tables

Explore similar work

CardsList
  1. VTR-Bench: A Systematic Benchmark for Evaluating Visual Text Rendering in Video Generation

    Oct 1, 2026Yu Huang, Jungang Li, Zhiyuan Wang +8Agentic Video GenerationVideo Generation

  2. VGI-Bench: Probing Visual Intelligence in Video Generation Models

    Aug 20, 2026Xuan He, Cong Wei, Yuhao Cheng +20Video Generation Evaluation