cs.LGOct 30, 2026

rl_rob: A transparent, from-scratch Python library for teaching reinforcement learning from tabular methods to deep policy gradients

Authors: Abdulrahman Altahhan

Organizations: School of Computer Science, University of Leeds, Leeds LS2 9JT, United Kingdom

Abstract

rl_rob is an open-source Python library for teaching reinforcement learning. It implements the arc of a modern course, from tabular temporal-difference learning through linear function approximation to deep value-based and policy-gradient methods, with every algorithm written from first principles so that its update rule is visible in a few lines of code. All agents share one interface, so learners can compare methods directly across stages and trace a deep reinforcement learning update from the temporal-difference error to the weight change. The library supports teaching and assessment in which students implement, modify and explain update rules, rather than only produce working code.

Explore similar work

CardsList
  1. RLLBC-Lib: An Educational Code Library for Reinforcement Learning and Learning-Based Control

    Sep 16, 2026Bernd Frauenknecht, Emma Cramer, Artur Eisele +9RL ControlReinforcement Learning

  2. Themis: An explainable AI-enabled framework for Reinforcement Learning with Human Feedback

    Jun 23, 2026Andreas Chouliaras, Luke Connolly, Dimitris ChatzpoulosReward ModelingHuman-in-the-Loop AI

  3. RDA: Reward Design Agent for Reinforcement Learning

    Jun 1, 2026Hojoon Lee, Ajay Subramanian, Ben Abbatematteo +4Agentic RLReinforcement Learning