cs.CLOct 8, 2026

Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation

Authors: Leikun Liang, Guoshuai Wang, Xingsheng He, Yushan Han, Yunyi Xuan, Xiaoxiao Xu, Lin Qu

Organizations: Alibaba Group Hangzhou, China

Abstract

Despite the adoption of large language models (LLMs) in recommendation systems, prevailing approaches mostly model single-type behaviors (e.g., views or purchases). Even when incorporating multiple behaviors, existing methods flatten heterogeneous actions into homogeneous token sequences, ignoring their distinct decision-making roles. This flattening fails to capture semantic hierarchies and contextual nuances in complex decision-making, such as trade-offs between price and quality. Consequently, performance degrades in critical ``difficult-choice'' scenarios involving highly similar items. To bridge this gap, we propose MARI (Memory-Augmented Recommendation with Interpretability), which grounds predictions in explicit, structured decision evidence. MARI maintains a Decision Memory Bank (DMB) that archives users' past rationales as Structured Decision Memories (SDMs): concise records of goals, constraints, and trade-offs. These SDMs are generated offline via Post-Hoc Decision Distillation from heterogeneous behaviors and user-generated content. By retrieving relevant SDMs to augment LLM reasoning, MARI achieves interpretability and scalability without the prohibitive cost of processing long raw sequences. Extensive experiments show MARI significantly outperforms state-of-the-art baselines on standard next-item prediction and a newly introduced Difficult Choice Prediction task, incurring low latency overhead by decoupling memory construction from online inference. Qualitative analyses reveal actionable, human-readable insights into user decision-making, marking a concrete step toward reasoning-aware recommendation systems.

Figures & tables

Explore similar work

CardsList
  1. Hierarchical Latent Reasoning for LLM-based Recommendation

    Jul 30, 2026Peiyu Hu, Siying Gu, Weihai Lu +8Sequential RecommendationRL for Language Model Reasoning

  2. RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation

    May 8, 2026Shijun Li, Pranav Belligundu, Tianxin Wei +3Agentic RAGRecommender Systems

  3. Pre-trained LLMs Meet Sequential Recommenders: Efficient User-Centric Knowledge Distillation

    Apr 23, 2026Nikita Severin, Danil Kartushov, Vladislav Urzhumov +8Sequential RecommendationLanguage Model Distillation