cs.IROct 5, 2026

Beyond Successor Accuracy: State Retention for Recursive Self-Improvement in Recommendation

Authors: Jinfeng Xu, Zheyu Chen, Ziyue Peng, Zheng Lin, Wenhao Yuan, Jian Chen, Shujie Li, Edith Ngai

Abstract

Recommendation recursive self-improvement (Rec-RSI) feeds recommender outputs into subsequent training. Evaluating each round solely through its latest model assumes that the successor consolidates the update, although pre- and post-update models may retain complementary ranking decisions. We term this \emph{distributed progress} and quantify it using cross-generation advantage (CGA), a marginally matched contrast between cross- and within-generation model pairs. A rank-separation statistic, label-free at selection time, predicts which family to retain. Across four datasets and three sequential recommendation encoders, the preferred retention regime varies by architecture: cross-generation pairing benefits GRU4Rec and SASRec, whereas FMLP initially favors within-generation pairing and shifts toward cross-generation pairing after a second update. Rank separation selects the stronger family in 12/12 first-update and 5/6 second-update dataset-encoder settings; on held-out tests, the selected family outperforms the direct successor in 34/36 trajectories. Five transfer mechanisms do not consistently reproduce these gains in one model. These findings establish state retention as a distinct Rec-RSI problem: progress may reside in relations between generations as well as in the latest model. Code is available at https://github.com/Jinfeng-Xu/RecRSI.

Explore similar work

CardsList
  1. RecRec: Recursive Refinement for Sequential Recommendation

    Jul 12, 2026Pervez Shaik, Prosenjit Biswas, Abhinav Thorat +2Sequential RecommendationIterative Refinement

  2. RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

    Jul 31, 2026Haoran Ling, Yuecheng Li, Zeyu Song +5Large Language Model-Guided OptimizationAgent Harness Optimization