cs.IRApr 4, 2026

Fusion and Alignment Enhancement with Large Language Models for Tail-item Sequential Recommendation

Authors: Zhifu Wei, Yizhou Dang, Guibing Guo, Chuang Zhao, Zhu Sun

Organizations: Northeastern University, Shenyang, China · Tianjin University, Tianjin, China · Singapore University of Technology and Design, Singapore, Singapore

Abstract

Sequential Recommendation (SR) learns user preferences from their historical interaction sequences and provides personalized suggestions. In real-world scenarios, most items exhibit sparse interactions, known as the tail-item problem. This issue limits the model's ability to accurately capture item transition patterns. To tackle this, large language models (LLMs) offer a promising solution by capturing semantic relationships between items. Despite previous efforts to leverage LLM-derived embeddings for enriching tail items, they still face the following limitations: 1) They struggle to effectively fuse collaborative signals with semantic knowledge, leading to suboptimal item embedding quality. 2) Existing methods overlook the structural inconsistency between the ID and LLM embedding spaces, causing conflicting signals that degrade recommendation accuracy. In this work, we propose a Fusion and Alignment Enhancement framework with LLMs for Tail-item Sequential Recommendation (FAERec), which improves item representations by generating coherently-fused and structurally consistent embeddings. For the information fusion challenge, we design an adaptive gating mechanism that dynamically fuses ID and LLM embeddings. Then, we propose a dual-level alignment approach to mitigate structural inconsistency. The item-level alignment establishes correspondences between ID and LLM embeddings of the same item through contrastive learning, while the feature-level alignment constrains the correlation patterns between corresponding dimensions across the two embedding spaces. Furthermore, the weights of the two alignments are adjusted by a curriculum learning scheduler to avoid premature optimization of the complex feature-level objective. Extensive experiments across three widely used datasets with multiple representative SR backbones demonstrate the effectiveness and generalizability of our framework.

Figures & tables

Explore similar work

CardsList
  1. SISA-Rec: A Semantically Integrated Sequential Recommender with Contrastive Alignment

    Jul 13, 2026Soohan Abbasi, Shahid Munir Shah, Rafia Shaikh +1Sequential RecommendationCold-Start Recommendation

  2. Generative Archetype-Grounded Item Representations for Sequential Recommendation

    Jun 9, 2026Yifan Li, Jiahong Liu, Xinni Zhang +5Sequential RecommendationRepresentation Learning

  3. The Best of the Two Worlds: Harmonizing Semantic and Hash IDs for Sequential Recommendation

    Dec 11, 2025Ziwei Liu, Yejing Wang, Wanyu Wang +6Semantic ID RecommendationSequential Recommendation