cs.LGDec 8, 2025

A Bayesian latent class reinforcement learning framework to capture adaptive, feedback-driven travel behaviour

Authors: Georges Sfeir, Stephane Hess, Thomas O. Hancock, Filipe Rodrigues, Jamal Amani Rad, Michiel Bliemer, Matthew Beck, Fayyaz Khan

Organizations: Choice Modelling Centre & Institute for Transport Studies, University of Leeds · DTU Management, Technical University of Denmark · Institute of Transport and Logistics Studies, University of Sydney · College of Business, Al Yamamah University, Riyadh, Saudi Arabia

Abstract

Many travel decisions involve a degree of experience formation, where individuals learn their preferences over time. At the same time, there is extensive scope for heterogeneity across individual travellers, both in their underlying preferences and in how these evolve. The present paper puts forward a Latent Class Reinforcement Learning (LCRL) model that allows analysts to capture both of these phenomena. We apply the model to a driving simulator dataset and estimate the parameters through Variational Bayes. We identify three distinct classes of individuals that differ markedly in how they adapt their preferences: the first displays context-dependent preferences with context-specific exploitative tendencies; the second follows a persistent exploitative strategy regardless of context; and the third engages in an exploratory strategy combined with context-specific preferences.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Bayesian Preference Learning for Test-Time Steerable Reward Models

    Feb 9, 2026Jiwoo Hong, Shao Tang, Zhipeng WangReward ModelingPreference Modeling

  2. Reason-guided Human Reward Modeling for Preference-based Reinforcement Learning

    Oct 16, 2026Anshul Nayak, Shahil Shaik, Jonathan Smereka +1Preference-Based RLReward Modeling