This paper introduces a score-driven rating system, a generalization of the classical Elo rating system that employs the score, i.e. the gradient of the log-likelihood, as the updating mechanism for player and team ratings. The proposed framework extends beyond simple win/loss game outcomes and accommodates a wide range of game results, such as point differences, win/draw/loss outcomes, or complete rankings. Theoretical properties of the score are derived, showing that it has zero expected value, sums to zero across all players, and decreases with increasing value of a player's rating, thereby ensuring internal consistency and fairness. Furthermore, the score-driven rating system exhibits a reversion property, meaning that ratings tend to follow the underlying unobserved true skills over time. The proposed framework provides a theoretical rationale for existing dynamic models of sports performance and offers a systematic approach for constructing new ones.
Figures & tables
Figure 1: Simulated paths of Elo ratings for seven players, with one player highlighted.
Figure 2: The score function for a win/loss game outcome, modeled by ( 9 ) with α=1 . The rating for player A is displayed on the x-axis, while it is fixed at 0 for player B .
Figure 3: The score function for a margin of victory game outcome, modeled by ( 21 ) with α=1 . The rating for player A is displayed on the x-axis, while it is fixed at 0 for player B .
Figure 4: The score function for a win/draw/loss game outcome, modeled by ( 25 ) with α=1 and δ=1 . The rating for player A is displayed on the x-axis, while it is fixed at 0 for player B .
Figure 5: The score function for a ranking game outcome with three players, modeled by ( 28 ) with α=1 . The rating for player A is displayed on the x-axis, while it is fixed at 1 for player B and at −1 for player C .
Figure 6: Simulated paths of score-driven ratings for three players. Players are paired randomly for win/loss games. The top plot shows a single realization, while the bottom plot presents the average across all simulations with 95 percent confidence bands.
Rating systems such as Elo serve as the gold standard for matchmaking in competitive chess. However, they inherently suffer from response lag due to their exclusive reliance on match outcomes, neglecting the granular quality of gameplay. Nevertheless, incorporating move-by-move information into rating adjustments presents a significant challenge given the substantial noise and the vastness of the game-state space. To address this, we propose the Drift-Diffusion-Enhanced Elo Rating System (DD-Elo), a novel skill assessment framework inspired by the drift diffusion model (DDM) from cognitive neuroscience. By modeling skill expression as a decision-making process, our model integrates move-level data to capture rapid skill fluctuations. We provide a rigorous mathematical derivation proving that DD-Elo maintains a bounded deviation from the traditional Elo system, ensuring theoretical alignment. Extensive experiments demonstrate that DD-Elo adapts to skill changes faster than Elo. Our findings suggest that DD-Elo offers an explainable, highly responsive, and backward-compatible solution for chess rating ecosystems. The implementation code is publicly available at https://github.com/Aquila-zhou1/DD-Elo .
Tianyuan Zhou, Zhizheng Fu, Tianming Yang
School of Intelligence Science and Technology Nanjing University Suzhou, China · Center for Excellence in Brain Science and Intelligence Technology Institute of Neuroscience Chinese Academy of Sciences Shanghai, China
This work reconciles two perspectives on the Elo ranking that coexist in the literature: the practitioner's view as a heuristic feedback rule, and the statistician's view as online maximum likelihood estimation via stochastic gradient ascent. Both perspectives coincide exactly in the binary case (iff the expected score is the logistic function). However, estimation noise forces a principled decoupling between the model used for ranking and the model used for prediction: the effective scale and home-field advantage parameter must be adjusted to account for the noise. We provide both closed-form corrections and a data-driven identification procedure. For multilevel outcomes, an exact relationship exists when outcome scores are uniformly spaced, but approximations are preferred in general: they account for estimation noise and better fit the data. The decoupled approach substantially outperforms the conventional one that reuses the ranking model for prediction, and serves as a diagnostic of convergence status. Applied to six years of FIFA men's ranking, we find that the ranking had not converged for the vast majority of national teams. The paper is written in a semi-tutorial style accessible to practitioners, with all key results accompanied by closed-form expressions and numerical examples.
We propose a distribution-free metric to rate individual skill in player-versus-environment'' settings, where participants face heterogeneous tasks without direct opponents. Such settings are common in digital platforms, games, education, finance, and the benchmark evaluation of AI agents. They combine high randomness, tasks of widely varying difficulty, and unknown heterogeneity across individuals. Our metric maps each task outcome to a bounded performance score with zero population mean and variance bounded by $1/3$, regardless of the outcome distribution, so that scores are directly comparable across tasks. Aggregating these scores over tasks yields an interpretable skill score for each individual (the Solo'' rating), and a reshuffling null model tests whether that score exceeds what chance alone would produce. We validate the approach on the progression of 2×105 players in the mobile games Candy Crush Saga and Bubble Witch 3 Saga. The metric identifies high- and low-skill players with high statistical confidence, their classification persists over hundreds of subsequent levels, and a windowed version of the score tracks changes in performance along progression.
David Reguera, Xavier R. Hoffmann, Irene Pérez +5
Universitat de Barcelona Institute of Complex Systems (UBICS), Universitat de Barcelona, 08028 Barcelona, Spain · King Shared Services S.L, Ciutat de Granada 150, 08018 Barcelona, Spain · Dribia Data Research, S. L., Pg. de Gràcia 55, E-08007 Barcelona, Spain