Learning from How Users Interpret: Personalizing Recommendation Explanation Order
Organizations: Paris-Dauphine University, PSL Research University UMR CNRS 7243, LAMSADE Paris, France
Abstract
Personalized explanations typically adapt their content or presentation based on preferences, interaction histories, or other user characteristics. We examine whether regularities inferred from prior textual interpretations can support personalization of explanation organization. In a controlled within participant study with 122 participants, prior interpretations were represented along three dimensions: information selection, relative salience, and relational organization. The relational dimension was partially operationalized through co mobilization. These representations were aggregated into fixed historical profiles and used to organize otherwise identical explanation sentences. Participants encountered four organization procedures: the OWN historical profile, the DONOR historical profile, a population profile called POP, and a language model procedure using the historical profile called PROFILE LLM. Post exposure objective comprehension was the primary outcome. OWN achieved 86.5 percent correct responses, compared with 66.0 percent for DONOR, 63.9 percent for POP, and 73.0 percent for PROFILE LLM. Mixed effects analyses showed higher comprehension with OWN than with each alternative procedure. No reliable overall condition effect was detected for recommendation acceptance. These findings indicate that historical profiles derived from prior interpretations can provide an actionable signal for personalizing explanation order while keeping explanatory content and wording fixed.
Figures & tables
| Stage | Sentence order |
|---|---|
| Initial order | Price Core attributes Experience conditions Availability Usage conditions Access |
| Selected pair | Price–Access |
| Final order | Price Access Core attributes Experience conditions Availability Usage conditions |
| ID | Decision context | Recommendation |
|---|---|---|
| T1 | Watch a film in a new city | Screening of Horizon 47 |
| T2 | Choose a cultural activity | Cartographies de lumière exhibition |
| T3 | Participate in a cooking workshop | Saveurs du Levant |
| T4 | Attend a musical performance | Ensemble Nova concert |
| Condition | Profile source | Ordering procedure |
|---|---|---|
| OWN | User | Fixed rule from Section 3.3 |
| DONOR | Another participant, same language | Same rule as OWN |
| POP | Other 121 participants, aggregated | Same rule as OWN |
| PROFILE-LLM | User | Mistral with target context, recommendation name, and six sentences |
| Condition / Contrast | Accuracy | OR [95% CI] | |
| OWN | 86.5% | – | – |
| DONOR | 66.0% | – | – |
| POP | 63.9% | – | – |
| PROFILE-LLM | 73.0% | – | – |
| OWN vs. DONOR | – | 3.82 [2.36, 6.18] | |
| OWN vs. POP | – | 4.23 [2.61, 6.84] |
| Condition | Factual | Integration |
|---|---|---|
| OWN | 89.3% | 83.6% |
| DONOR | 72.1% | 59.8% |
| POP | 68.9% | 59.0% |
| PROFILE-LLM | 81.1% | 64.8% |
| Condition | Compr. | Effort | Natural. | Accept. Yes |
|---|---|---|---|---|
| OWN | 63.1% | 23.0% | 54.9% | 39.3% |
| DONOR | 32.8% | 36.1% | 27.9% | 41.0% |
| POP | 34.4% | 36.1% | 36.1% | 45.9% |
| PROFILE-LLM | 44.3% | 36.1% | 37.7% | 45.9% |
| Condition | EN | FR |
|---|---|---|
| OWN | 85.7% | 86.9% |
| DONOR | 64.3% | 66.9% |
| POP | 64.3% | 63.7% |
| PROFILE-LLM | 70.2% | 74.4% |
Explainable Recommendation
Explainable recommendation develops systems that show users the evidence and preferences behind suggested items, rankings, or decisions.
See all 46 papers