From Logs to Language: Learning Optimal Verbalization for LLM-Based Recommendation at Industry Scale
Organizations: University of Georgia · Netflix · Capital One · Hong Kong Polytechnic University
Abstract
Large language models (LLMs) are promising backbones for generative recommender systems, yet a key challenge remains underexplored: verbalization, i.e., converting structured user interaction logs into effective natural language inputs. Existing methods rely on rigid templates that simply concatenate fields, yielding suboptimal representations for recommendation. We propose a data-centric framework that learns verbalization for LLM-based recommendation. Using reinforcement learning, a verbalization agent transforms raw interaction histories into optimized textual contexts, with recommendation accuracy as the training signal. This agent learns to filter noise, incorporate relevant metadata, and reorganize information to improve downstream predictions. Experiments on a large-scale industrial streaming dataset from Netflix show that learned verbalization delivers up to 93% relative improvement in discovery item recommendation accuracy over template-based baselines. Further analysis reveals emergent strategies such as user interest summarization, noise removal, and syntax normalization, offering insights into effective context construction for LLM-based recommender systems.
Figures & tables
| Configuration | Recall@1 % |
|---|---|
| Template Baseline (8B) | – |
| Zero-Shot Verbalizer | +5.3 |
| Action-Based Verbalizer | +10.7 |
| Rewrite Verbalizer | +12.5 |
| Rewrite + Trained Reasoner | +92.9 |
| Ablation | Recall@1 % |
|---|---|
| Full Pipeline | +92.9 |
| Verbalizer Variants | |
| Action-Based only | +10.7 |
| Rewrite Verbalizer | +12.5 |
| Reasoner Training Data | |
| Raw Interactions | +42.8 |
| Raw Interaction: |
| 20261022 Wednesday 8:45 PM, ID: 123456, Stranger Things, year: 2016, plot: nostalgic, supernatural, Thumb Up |
| Verbalized Output (8B): |
| Wednesday 8:45 PM gave a strong positive rating to Stranger Things, a 2016 sci-fi horror with a nostalgic and supernatural plot |
| Verbalized Output (32B): |
| Strong preference signal: enthusiastic rating for Stranger Things indicates high interest in nostalgic, supernatural sci-fi horror series |
Large Language Model-Based Recommendation
Large language model-based recommendation uses language models to personalize ranking, retrieval, and conversational suggestions from text and behavior.
See all 210 papers