Exploiting Exogenous Structure for Sample-Efficient Reinforcement Learning [2409.14557]