cs.LGApr 14, 2026

Is Sliding Window All You Need? An Open Framework for Long-Sequence Recommendation

Authors: Sayak Chakrabarty, Souradip Pal

Organizations: Department of Computer Science, Northwestern University, Evanston, IL 60208, USA · School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA

Abstract

Long interaction histories are central to modern recommender systems, yet training with long sequences is often dismissed as impractical under realistic memory and latency budgets. This work demonstrates that it is not only practical but also effective-at academic scale. We release a complete, end-to-end framework that implements industrial-style long-sequence training with sliding windows, including all data processing, training, and evaluation scripts. Beyond reproducing prior gains, we contribute two capabilities missing from earlier reports: (i) a runtime-aware ablation study that quantifies the accuracy-compute frontier across windowing regimes and strides, and (ii) a novel k-shift embedding layer that enables million-scale vocabularies on commodity GPUs with negligible accuracy loss. Our implementation trains reliably on modest university clusters while delivering competitive retrieval quality (e.g., up to +6.04% MRR and +6.34% Recall@10 on Retailrocket) with ∼4×\sim 4 \times training-time overheads. By packaging a robust pipeline, reporting training time costs, and introducing an embedding mechanism tailored for low-resource settings, we transform long-sequence training from a closed, industrial technique into a practical, open, and extensible methodology for the community.

Figures & tables

Explore similar work

CardsList
  1. REPREC: Representation Driven Parameter-Efficient Recommendation System

    Jul 24, 2026Harshini Kavuru, Dwipam Katariya, Giri Iyengar +3Sequential RecommendationLarge Language Model-Based Recommendation