cs.LGAug 20, 2025

LFM4Ads: Large Foundation Model for Ads Recommendation

Authors: Jie Jiang, Shangyu Zhang, Shijie Quan, Zhongren Wang, Tianqu Zhuang, Junwei Pan, Bo Fu, Yilong Sun, 

Organizations: Tencent Company, China · Tsinghua University, China

Abstract

Recent work leverages large-scale pretrained foundation models (FMs) to transfer generalizable representations to downstream advertising tasks. Most existing approaches transfer user representations (URs) and item representations (IRs), while underutilizing the user-item cross representations (CRs) generated by deeper interaction layers. Although a recent work transfers target-aware embeddings (TAEs), it requires real-time upstream FM inference alongside the downstream, introducing additional engineering complexity and overhead. To address these limitations, we propose Large Foundation Model for Ads Recommendation (LFM4Ads), an efficient pretrain-then-transfer paradigm for cross-domain ad recommendation. LFM4Ads jointly exploits URs, IRs, and CRs from the upstream FM. It extracts sample-level CRs from pretrained interaction layers and aggregates them into user-level CRs using a time-aware exponential moving average, thereby decoupling upstream inference from downstream online serving. To use CRs efficiently, we propose three downstream usages at different levels of granularity: feature-level gating to fuse CRs into downstream embeddings, module-level fine-tuning to yield downstream CRs, and model-level retrieval by matching CRs with IRs. LFM4Ads has been deployed on Tencent's advertising platform since Q4 2024. It has supported 10+ launches across major scenarios, yielding a platform-wide gross merchandise value (GMV) lift of 2.45% and annual revenue gains in the hundreds of millions of dollars. Offline experiments on KuaiRand-1K further demonstrate our effectiveness. Our code is available at https://github.com/ZhuangQu/LFM4Ads.

Figures & tables

Explore similar work

CardsList
  1. Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training

    Aug 7, 2026Oseong Choi, Hoeinn Kim, Jihoon Lee +2Recommender SystemsRL Post-Training

  2. Fine-Tuned LLM as a Complementary Predictor Improving Ads System

    May 27, 2026Hui Yang, Daiwei He, Kevin Jiang +20LLM Fine-TuningOnline Advertising

  3. Generative Recommendation for Large-Scale Advertising

    Feb 26, 2026Ben Xue, Dan Liu, Lixiang Wang +27RL for RecommendationRecommender Systems