Profiling What Matters: Context-Aware Item Profiles from Large-Scale Metadata for LLM Recommenders
Organizations: Korea University Seoul, Republic of Korea · KT Corporation Seoul, Republic of Korea
Abstract
While Large Language Models (LLMs) have significantly advanced reranking in recommendation, effectively leveraging item-side information remains challenging. Real-world items are described by vast, heterogeneous, and unstructured metadata, where decision-relevant signals are often implicit, noisy, or buried in long descriptions. Moreover, feature salience is highly context-dependent, varying not only across items but also across users. Existing methods often rely on item titles, fixed attributes, or static item summaries, which limit personalized and fine-grained item understanding. To bridge this gap, we propose CAIRO, a user context-aware item profiling framework for LLM-based reranking. CAIRO first structures raw metadata and reviews into objective features and subjective traits, and employs a lightweight profiler to select the most relevant information for each user-item pair with limited serving-time overhead. The resulting profiles are concise and context-specific, providing relevant item-side evidence for the LLM's ranking decision. Experiments show that CAIRO consistently improves LLM-based reranking, highlighting the importance of item profiling that effectively exploits vast item-side information.
Figures & tables
| Methods | Video Games | Sports and Outdoors | Electronics | |||||||||
| nDCG@5 | HR@5 | nDCG@10 | HR@10 | nDCG@5 | HR@5 | nDCG@10 | HR@10 | nDCG@5 | HR@5 | nDCG@10 | HR@10 | |
| BPR | 0.0698 | 0.1211 | 0.1252 | 0.2961 | 0.0793 | 0.1305 | 0.1303 | 0.3082 | 0.0540 | 0.0960 | 0.1086 | 0.2619 |
| SASRec | 0.1599 | 0.2205 | 0.1952 | 0.3349 | 0.1658 | 0.2203 | 0.1968 | 0.3172 | 0.1399 | 0.1835 | 0.1650 | 0.2868 |
| BERT4Rec | 0.1488 | 0.2123 | 0.1842 | 0.3226 | 0.1247 | 0.1825 | 0.1613 | 0.2967 | 0.0938 | 0.1372 | 0.1215 | 0.2237 |
| xDeepFM | 0.0932 | 0.1679 | 0.1621 | 0.3834 | 0.0897 | 0.1637 | 0.1638 | 0.3959 | 0.0879 | 0.1491 | 0.1497 | 0.3444 |
| AdaFS | 0.1401 | 0.2140 | 0.2030 | 0.4119 | 0.1247 | 0.2109 | 0.1937 | 0.4273 | 0.1029 | 0.1752 | 0.1762 | 0.4054 |
| Dataset | Video Games | Sports and Outdoors | Electronics |
| # Interactions | 263,782 | 232,923 | 223,173 |
| # Users | 31,937 | 30,734 | 30,403 |
| # Items | 9,233 | 19,549 | 13,711 |
| Sparsity | 99.91% | 99.96% | 99.95% |
| Common features | main_category , title , average_rating , rating_number , price , store , features , description , categories , parent_asin , bought_together | ||
| Optional features | language , rated , genre , batteries , power source , (total 266) | color , size , material , sport type , model year , (total 964) | item weight , material , color , voltage , country of origin , (total 705) |
| Electronics | |||||
| Method | nDCG@5 | HR@5 | nDCG@10 | HR@10 | Profiling Time |
| REAP (5-hop) | 0.1844 | 0.2728 | 0.2460 | 0.4657 | 815.70s |
| REAP (1-hop) | 0.1894 | 0.2729 | 0.2556 | 0.4800 | 346.63s |
| \proposed | 0.1892 | 0.2771 | 0.2673 | 0.5214 | 0.32s |
| Sports and Outdoors | |||||
| Method | nDCG@5 | HR@5 | nDCG@10 | HR@10 | Profiling Time |
| Dataset | Method | Offline | Online | ||
| # LLM Calls | Avg. Token | Profiling Time | Reranking Time † | ||
| Video Games | EXP3RT | 7.55 | 4584.6 | – | 2.89s |
| \proposed | 7.84 | 4112.4 | 0.21s | 3.03s | |
| Sports and Outdoors | EXP3RT | 7.55 | 4887.6 | – | 3.15s |
| \proposed | 8.18 | 4954.4 | 0.22s | 3.02s | |
| Electronics | EXP3RT | 6.97 | 4337.6 | – | 3.52s |
| Dataset | Strategy | nDCG@5 | HR@5 | nDCG@10 | HR@10 |
| Video Games | K-Frequency | 0.1732 | 0.2585 | 0.2330 | 0.4461 |
| K-MergeMore | 0.1734 | 0.2617 | 0.2402 | 0.4711 | |
| T-Single | 0.1840 | 0.2723 | 0.2366 | 0.4370 | |
| \proposed | 0.1843 | 0.2778 | 0.2438 | 0.4622 | |
| Electronics | K-Frequency | 0.1713 | 0.2560 | 0.2359 | 0.4587 |
| K-MergeMore | 0.1735 | 0.2618 | 0.2342 | 0.4529 |
| Dataset | Strategy | nDCG@5 | HR@5 | nDCG@10 | HR@10 |
| Video Games | O-Random | 0.1799 | 0.2701 | 0.2393 | 0.4503 |
| O-All | 0.1782 | 0.2643 | 0.2304 | 0.4290 | |
| O-Sim | 0.1832 | 0.2679 | 0.2394 | 0.4441 | |
| S-Random | 0.1797 | 0.2658 | 0.2368 | 0.4448 | |
| S-All | 0.1744 | 0.2555 | 0.2299 | 0.4302 | |
| \proposed | 0.1843 | 0.2778 | 0.2438 | 0.4622 |
| Item : B0B6WTFTG9 (Google Pixel Buds Pro - Noise Canceling Earbuds …) |
| Case #1: User ID AHTS2DVIJSO6IARPLRV55RGDHMMA |
| User profile : This user consumes electronics primarily to enhance the protection and functionality of their devices. While they value high quality and durability, they consistently criticize comfort issues and poor functionality , …. |
| Item profile: |
| Audio Technology : Active Noise Cancellation with custom 11 mm drivers |
| Included Accessories : Earbuds, Eartips, Wireless Charging Case |
| User-specific Trait : Comparative Evaluation; Users are actively comparing these earbuds with competitors, focusing on sound performance, noise cancellation, and overall features. … |
Large Language Model-Based Recommendation
Large language model-based recommendation uses language models to personalize ranking, retrieval, and conversational suggestions from text and behavior.
See all 210 papers