Follow-the-Regularized-Leader
Also known as FTRL
Overview
Follow-the-Regularized-Leader (FTRL) studies how to make a sequence of decisions by minimizing past losses together with a regularization term that shapes the learner’s behavior. Researchers use regularizers such as entropy and log-barrier functions, and develop optimistic, adaptive, and parameter-free variants related to Online Mirror Descent. Applications include online convex optimization, bandits, reinforcement learning in Markov decision processes, decentralized optimization, and learning in games, where performance is measured by regret or convergence to equilibrium. A central challenge is obtaining strong guarantees across different feedback and environment types while controlling stability, computational cost, and last-iterate behavior.
Latest papers
25 papers4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.