Organizations: School of Artificial Intelligence, Shenzhen University, Shenzhen 518060, China · Shenzhen Technology University, Shenzhen, China · College of Computer Science, Chongqing University, Chongqing, China
User interests typically encompass both long-term preferences and short-term intentions, reflecting the dynamic nature of user behaviors across different timeframes. The uneven temporal distribution of user interactions highlights the evolving patterns of interests, making it challenging to accurately capture shifts in interests using comprehensive historical behaviors. To address this, we propose SLSRec, a novel Session-based model with the fusion of Long- and Short-term Recommendations that effectively captures the temporal dynamics of user interests by segmenting historical behaviors over time. Unlike conventional models that combine long- and short-term user interests into a single representation, compromising recommendation accuracy, SLSRec utilizes a self-supervised learning framework to disentangle these two types of interests. A contrastive learning strategy is introduced to ensure accurate calibration of long- and short-term interest representations. Additionally, an attention-based fusion network is designed to adaptively aggregate interest representations, optimizing their integration to enhance recommendation performance. Extensive experiments on three public benchmark datasets demonstrate that SLSRec consistently outperforms state-of-the-art models while exhibiting superior robustness across various scenarios.We will release all source code upon acceptance.
Figures & tables
Figure 1: The overall architecture of SLSRec
Figure 2: Short-term interest encoder
Figure 3: Long-term interest encoder
Dataset
#Users
#Items
#Inte.
#Cate.
#Avg. Len
Taobao
42,966
103,204
2,089,165
2,936
48.62
Tmall
76,853
114,209
5,130,294
2,113
66.76
Cosmetics
2,515
5,288
109,580
309
43.57
Table 1: Statistics of the datasets.
Dataset
Model
AUC
GAUC
MRR
NDCG@2
NDCG@5
NDCG@10
HIT@2
HIT@5
HIT@10
Taobao
NCF An et al. (2019)
0.7261
0.7356
0.2215
0.1689
0.2094
0.2423
0.1874
0.2786
0.3810
DIN Zhou et al. (2018)
0.8264
0.8442
0.4848
0.4429
0.4942
0.5212
0.4773
0.5910
0.6742
CASER Tang and Wang (2018)
0.8446
0.8491
0.4590
0.4150
0.4690
0.4976
0.4518
0.5714
0.6597
GRU4REC Hidasi and Karatzoglou (2018)
0.8580
0.8537
0.4639
0.4214
0.4732
0.4999
0.4573
0.5719
0.6545
DIEN Zhou et al. (2019)
0.8455
0.8441
0.4763
0.4364
0.4848
0.5092
0.4695
0.5767
0.6520
SASREC Kang and McAuley (2018)
0.8419
0.8441
0.4897
0.4505
0.4995
0.5234
0.4834
0.5916
0.6555
Table 2: Performance comparison.
Dataset
Model
AUC
MRR
NDCG@2
HIT@2
Taobao
SLSREC
0.9076
0.5528
0.5109
0.5513
w/o CL
0.9026
0.5316
0.4874
0.5279
w/o cate
0.8985
0.5167
0.4710
0.5119
w/o long
0.8639
0.4992
0.4588
0.4936
w/o short
0.6559
0.1624
0.1064
0.1238
Tmall
SLSREC
0.8599
0.4698
0.4252
0.4509
Table 3: Ablation study results on three datasets.
Figure 4: λ analyses of SLSRec on the Taobao and Cosmetics dataset
Figure 5: Impact of ω variation on the effectiveness of SLSRec across Taobao and Cosmetics datasets
Personalized news recommendation is highly time-sensitive, as user interests are often driven by emerging events, trending topics, and shifting real-world contexts. These dynamics make it essential to model not only users' long-term preferences, which reflect stable reading habits and high-order collaborative patterns, but also their short-term, context-dependent interests that change rapidly over time. However, most existing approaches rely on a single static interaction graph, which struggles to capture both long-term preference patterns and short-term interest changes as user behavior evolves. To address this challenge, we propose a unified framework that learns user preferences from both global and local temporal perspectives. A global preference modeling component captures long-term collaborative signals from the overall interaction graph, while a local preference modeling component partitions historical interactions into stage-wise temporal subgraphs to represent short-term dynamics. Within this module, an LSTM branch models the progressive evolution of recent interests, and a self-attention branch captures long-range temporal dependencies. Extensive experiments on two large-scale real-world datasets show that our approach consistently outperforms strong baselines and delivers fresher and more relevant recommendations across diverse user behaviors and temporal settings.
Zhiyong Cheng, Yike Jin, Zhijie Zhang +3
The School of Computer Science and Information Engineering, Hefei University of Technology, Anhui, China · Institute of Artificial intelligence, Hefei Comprehensive National Science Center, Anhui, China
Modeling long sequences of user behaviors has emerged as a critical frontier in generative recommendation. However, existing solutions face a dilemma: linear attention mechanisms achieve efficiency at the cost of retrieval precision due to limited state capacity, while softmax attention suffers from prohibitive computational overhead. To address this challenge, we propose HyTRec, a model featuring a Hybrid Attention architecture that explicitly decouples long-term stable preferences from short-term intent spikes. By assigning massive historical sequences to a linear attention branch and reserving a specialized softmax attention branch for recent interactions, our approach restores precise retrieval capabilities within industrial-scale contexts involving ten thousand interactions. To mitigate the lag in capturing rapid interest drifts within the linear layers, we furthermore design Temporal-Aware Delta Network (TADN) to dynamically upweight fresh behavioral signals while effectively suppressing historical noise. Empirical results on industrial-scale datasets confirm the superiority that our model maintains linear inference speed and outperforms strong baselines, notably delivering over 8% improvement in Hit Rate for users with ultra-long sequences with great efficiency.
Lei Xin, Yuhao Zheng, Ke Cheng +3
Shanghai Dewu Information Group · Wuhan University · USTC +1
Sequential recommendation aims to predict the next item a user will interact with based on their historical behavior. Advances in Transformers have significantly improved sequential recommendation but are still limited by cost efficiency. Although State Space Models (SSMs) have recently enabled efficient long-range modeling, most existing methods encode each item with a single static contextual role, overlooking the phenomenon of item polysemy. In fact, the same item often plays different semantic roles depending on user context, and existing methods are limited in capturing dynamic behavior across different temporal granularities. In this work, we propose DSRec, a novel dual-interest cross-SSM model that explicitly disentangles item roles across long-term and short-term semantic context. Sequential items are encoded into long-term interest embeddings that capture stable preferences via historical aggregation, and a short-term interest branch that emphasizes local session intent modulated by inter-click time intervals. These interest embeddings are processed through distinct SSM encoders: a full-sequence Mamba for long-term modeling, and a time-modulated SSM that dynamically adjusts state evolution based on temporal gaps. To enable effective cross-granularity alignment, we adopt a residual cross-fusion mechanism that exchanges contextual information between the two branches while preserving semantic independence. Experiments on public benchmarks demonstrate that DSRec outperforms other state-of-the-art methods.
Shuiying Liao, P. Y. Mok
The Hong Kong University of Science and Technology Clear Water Bay, Hong Kong