cs.LGOct 30, 2026

Hyperbolic Inverse Reinforcement Learning

Authors: Iulia Rusu, Anoop Praturu, Sergei Gepshtein, Tatyana Sharpee

Organizations: University of California San Diego · Salk Institute for Biological Studies · Causal Labs

Abstract

Inverse reinforcement learning (IRL) seeks to infer the reward function underlying observed behavior, but its predictive accuracy and interpretability depend on how that reward is computed from the underlying features. While prior IRL reward functions have been implemented through a variety of techniques including linear weights, neural networks, or other function approximators, none make assumptions about the geometry of the underlying feature space. Inspired by geometric organization observed in neural circuits, we introduce Hyperbolic inverse reinforcement learning (Hyperbolic IRL), which parameterizes reward as a function of Hyperbolic distance between the feature vector and a learned parameter vector, as well as its Euclidean distance variant. We tested our methods against a range of linear and nonlinear IRL baselines under both deterministic and stochastic policies. Our Hyperbolic approach achieved comparable performance to state-of-the-art models on established benchmarks and excelled in the low data limit and across dense environments. Applied to human navigation among multiple exhibits in a museum room, Hyperbolic IRL reveals reward structure that depends not only on individual exhibit-distance features, but also on non-separable conjunctions between them. Together, these results demonstrate that a Hyperbolic reward parameterization can improve both the predictive accuracy and interpretability of IRL, providing a framework for studying how non-separable, conjunctive structure can begin to explain behavior.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Inverse Reinforcement Learning without an Optimal Demonstrator: A Feasible Reward Set Approach

    May 29, 2026Kihyun Kim, Shripad Deshmukh, Nikos Vlassis +1Reinforcement LearningLearning from Demonstration

  2. Nonparametric Bayesian Inverse Reinforcement Learning with Data-Parallel Gibbs Sampling

    Jul 10, 2026Sai Anirudh Katupilla, Shreeya Dasa LakshminathReinforcement LearningBayesian Inference

  3. Inverse Reinforcement Learning with Just Classification and a Few Regressions

    Sep 25, 2025Lars van der Laan, Nathan Kallus, Aurelien BibautReinforcement LearningMaximum Entropy RL