ReFORM: Review-aggregated Profile Generation via LLM with Multi-Factor Attention for Restaurant Recommendation
Organizations: University of Southern California, USA · Sejong University, South Korea
Abstract
In recommender systems, large language models (LLMs) have gained popularity for generating descriptive summarization to improve recommendation robustness, along with Graph Convolution Networks. However, existing LLM-enhanced recommendation studies mainly rely on the internal knowledge of LLMs about item titles while neglecting the importance of various factors influencing users' decisions. Although information reflecting various decision factors of each user is abundant in reviews, few studies have actively exploited such insights for recommendation. To address these limitations, we propose a ReFORM: Review-aggregated Profile Generation via LLM with Multi-FactOr Attentive RecoMmendation framework. Specifically, we first generate factor-specific user and item profiles from reviews using LLM to capture a user's preference by items and an item's evaluation by users. Then, we propose a Multi-Factor Attention to highlight the most influential factors in each user's decision-making process. In this paper, we conduct experiments on two restaurant datasets of varying scales, demonstrating its robustness and superior performance over state-of-the-art baselines. Furthermore, in-depth analyses validate the effectiveness of the proposed modules and provide insights into the sources of personalization. Our source code and datasets are available at https://github.com/m0onsoo/ReFORM.
Figures & tables
| Baseline | Yelp | Google Restaurants | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| R@10 | R@20 | N@10 | N@20 | R@10 | R@20 | N@10 | N@20 | |||
| Graph Convolution Networks (GCN) Methods | ||||||||||
| GCCF | 0.0390 | 0.0643 | 0.0331 | 0.0414 | 0.0570 | 0.0925 | 0.0351 | 0.0457 | ||
| LightGCN | 0.0421 | 0.0702 | 0.0357 | 0.0450 | 0.0574 | 0.0931 | 0.0357 | 0.0464 | ||
| Self-supervised GCN Methods | ||||||||||
| SGL | 0.0485 | 0.0806 | 0.0409 | 0.0516 | 0.0583 | 0.0932 | 0.0362 | 0.0468 | ||
| Method | Yelp | Google Restaurants | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| R@20 | (%) | N@20 | (%) | R@20 | (%) | N@20 | (%) | |||
| ReFORM | 0.1062 | - | 0.0683 | - | 0.1088 | - | 0.0545 | - | ||
| w/o cuisine type | 0.0982 | -7.53 | 0.0634 | -7.17 | 0.0932 | -14.34 | 0.0468 | -14.13 | ||
| w/o flavor | 0.1032 | -2.82 | 0.0664 | -2.78 | 0.1004 | -7.72 | 0.0505 | -7.34 | ||
| w/o atmosphere | 0.1055 | -0.66 | 0.0679 | -0.59 | 0.1030 | -5.33 | 0.0519 | -4.77 | ||
| w/o price | 0.1060 | -0.19 | 0.0681 | -0.29 | 0.1069 | -1.75 | 0.0538 | -1.28 | ||
| Noise ratio | R@20 | (%) | N@20 | (%) |
|---|---|---|---|---|
| 0 | 0.1088 | – | 0.0545 | – |
| 0.5 | 0.0962 | -11.58 | 0.0481 | -11.74 |
| 1.0 | 0.0915 | -15.9 | 0.0457 | -16.15 |
Recommender Systems
Recommender systems predict and rank items for people using interaction histories, content, context, and feedback.
See all 514 papers