Exploration Exploitation Trade

Exploration-exploitation trade-off research focuses on balancing the need to explore unknown areas of a search space against exploiting currently known promising regions to optimize a given objective. Current research emphasizes developing algorithms and model architectures (e.g., Bayesian optimization, reinforcement learning, multi-armed bandits) that dynamically adjust this balance, often incorporating uncertainty estimation and adaptive exploration strategies. This work is significant because efficient exploration-exploitation strategies are crucial for optimizing complex systems across diverse fields, including robotics, machine learning, and resource management, leading to improved efficiency and performance in various applications.

Papers

October 12, 2022

Maximum entropy exploration in contextual bandits with neural networks and energy based models
Adam Elwood, Marco Leonardi, Ashraf Mohamed, Alessandro Rozza
Neural Network Full Model Contextual Bandit Energy Policy Research Exploration Exploitation Trade Entropy Exploration Reward Estimator

October 11, 2022

The Role of Exploration for Task Transfer in Reinforcement Learning
Jonathan C Balloch, Julia Kim, and Jessica L Inman, Mark O Riedl
Reinforcement Learning Integral Role Environment Exploration Exploration Method Exploration Exploitation Trade Exploration Strategy

May 30, 2022

SEREN: Knowing When to Explore and When to Exploit
Changmin Yu, David Mguni, Dong Li, Aivar Sootla, Jun Wang, Neil Burgess
Reinforcement Learning Algorithm Efficient Reinforcement Learning Exploration Exploitation Trade Exploration Policy

May 26, 2022

Exploration, Exploitation, and Engagement in Multi-Armed Bandits with Abandonment
Zixian Yang, Xin Liu, Lei Ying
Multi Armed Bandit Q Learning Environment Exploration Recommendation System Real World eXploitation Logarithmic Regret Exploration Exploitation Trade Active CR Engagement

February 28, 2022

Rectified Max-Value Entropy Search for Bayesian Optimization
Quoc Phong Nguyen, Bryan Kian Hsiang Low, Patrick Jaillet
Bayesian Optimization Mutual Information Acquisition Function Exploration Exploitation Trade Max Value Entropy Search

February 27, 2022

Federated Online Sparse Decision Making
Chi-Hua Wang, Wenjie Li, Guang Cheng, Guang Lin
Linear Contextual Bandit Exploration Exploitation Trade Armed Bandit Egocentric AI Multi Player Multi Armed Bandit

December 19, 2021

Exploration-exploitation trade-off for continuous-time episodic reinforcement learning with linear-convex models
Lukasz Szpruch, Tanut Treetanthiploet, Yufei Zhang
Model Based Reinforcement Learning Finite Horizon Episodic Reinforcement Learning Exploration Exploitation Trade Performance Gap Convex Model

November 12, 2021

Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs
Raul Astudillo, Daniel R. Jiang, Maximilian Balandat, Eytan Bakshy, Peter I. Frazier
Bayesian Optimization Black Box Function Exploration Exploitation Trade