cs.IRJun 17, 2026

Token Factory: Efficiently Integrating Diverse Signals into Large Recommendation Models

Authors: Xilun ChenShao-Chuan WangBaykal CakiciLukasz HeldtLichan HongRaghu KeshavanAniruddh NathLi Wei+1 more

Organizations: Google · USA

Abstract

Large Recommendation Models (LRMs) have demonstrated promising capabilities in industry-scale recommendation tasks. However, holistically integrating traditional signals into these transformer-based architectures effectively and efficiently remains a major challenge. Conventional approaches that "textualize" these signals directly or create discrete item representations often lead to excessively long prompts, substantial memory footprints, and high computational overhead. To overcome these limitations, we propose "Token Factory", a framework designed to transform traditional signals into "soft tokens" that can be directly processed by LRMs. This approach enables efficient integration and compression of heterogeneous input features, preventing prompt length explosion while enhancing model performance. We detail the architecture of Token Factory and present experimental results validating its effectiveness in a production-scale recommendation environment.

Explore similar work

CardsList
  1. SlimPer: Make Personalization Model Slim and Smart

    Jul 14, 2026Siqi Wang, Xianjie Chen, Shaofeng Deng +42PersonalizationGenerative Models