cs.LGApr 8, 2026

Are Stochastic Multi-objective Bandits Harder than Single-objective Bandits?

Authors: Changkun Guan, Mengfan Xu

Organizations: H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology · Mechanical and Industrial Engineering, University of Massachusetts Amherst

Abstract

Multi-objective bandits have attracted increasing attention for their broad applicability, with dd-dimensional reward vectors inducing Pareto regret. There has been a subtle debate over whether this added structure makes the problem fundamentally harder than single-objective bandits. We answer this by showing that, in terms of Pareto regret, it is surprisingly no harder: Pareto regret scales inversely with g†g^\dagger, the largest objective-wise suboptimality gap, and thus matches the smallest objective-wise classical regret. We formalize this idea via a novel method with upper and lower confidence-bound estimators for every arm-objective pair. It uses top-two races to compare arms within each objective and an uncertainty-greedy rule to allocate exploration toward the largest objective-wise gap g†g^\dagger, until the corresponding Pareto-optimal arm is committed to. We prove that it achieves Pareto regret of O(\nicefraclog⁡Tg†)O(\nicefrac{\log T}{g^\dagger}), where TT is the horizon, with \emph{no dependence on dd}. A matching lower bound of Ω(\nicefraclog⁡Tg†)Ω(\nicefrac{\log T}{g^\dagger}) implies optimality. We evaluate the method on synthetic and real-world datasets, confirming the theory and achieving order-of-magnitude reductions in Pareto regret over baselines. Real-world results further show that our method commits to a Pareto optimal arm, possibly at the cost of empirical fairness, suggesting a potential hardness absent in single-objective bandits.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. The Role of Coordinates in Pareto Regret for Adversarial Multi-Objective Bandits

    Sep 19, 2026Changkun Guan, Mengfan XuMulti-Armed BanditsAdversarial Bandits

  2. Top-kk Pareto Bandits: Hypervolume Regret for Multi-Objective Slate Selection

    Jul 28, 2026Nicolas Gutowski, Fabien Chhel, Alexandre Letard +1Multi-Armed BanditsCombinatorial Multi-Armed Bandits

  3. Best-of-Both-Worlds Multi-Dueling Bandits: Unified Algorithms for Stochastic and Adversarial Preferences under Condorcet and Borda Objectives

    Mar 19, 2026S Akash, Pratik Gajane, Jawar SinghMulti-Armed BanditsAdversarial Bandits