cs.LGMar 19, 2026

Best-of-Both-Worlds Multi-Dueling Bandits: Unified Algorithms for Stochastic and Adversarial Preferences under Condorcet and Borda Objectives

Authors: S Akash, Pratik Gajane, Jawar Singh

Organizations: Indian Institute of Technology Patna, India · University of Orléans, France

Abstract

Multi-dueling bandits, where a learner selects m≥2m \geq 2 arms per round and observes only the winner, arise naturally in many applications including ranking and recommendation systems, yet a fundamental question has remained open: can a single algorithm perform optimally in both stochastic and adversarial environments, without knowing which regime it faces? We answer this affirmatively, providing the first best-of-both-worlds algorithms for multi-dueling bandits under both Condorcet and Borda objectives. For the Condorcet setting, we propose MetaDueling\texttt{MetaDueling}, a black-box reduction that converts any dueling bandit algorithm into a multi-dueling bandit algorithm by transforming multi-way winner feedback into an unbiased pairwise signal. Instantiating our reduction with Versatile-DB\texttt{Versatile-DB} yields the first best-of-both-worlds algorithm for multi-dueling bandits: it achieves O(KT)O(\sqrt{KT}) pseudo-regret against adversarial preferences and the instance-optimal O(∑i≠a⋆log⁡TΔi)O\left(\sum_{i \neq a^\star} \frac{\log T}{Δ_i}\right) pseudo-regret under stochastic preferences, both simultaneously and without prior knowledge of the regime. For the Borda setting, we propose SA-MiDEX\texttt{SA-MiDEX}, a stochastic-and-adversarial algorithm that achieves O(K2log⁡KT+Klog⁡2T+∑i:ΔiB>0Klog⁡KT(ΔiB)2)O\left(K^2 \log KT + K \log^2 T + \sum_{i: Δ_i^{\mathrm{B}} > 0} \frac{K\log KT}{(Δ_i^{\mathrm{B}})^2}\right) regret in stochastic environments and O(KTlog⁡KT+K1/3T2/3(log⁡K)1/3)O\left(K \sqrt{T \log KT} + K^{1/3} T^{2/3} (\log K)^{1/3}\right) regret against adversaries, again without prior knowledge of the regime. We complement our upper bounds with matching lower bounds for the Condorcet setting. For the Borda setting, our upper bounds are near-optimal with respect to the lower bounds (within a factor of KK) and match the best-known results in the literature.

Explore similar work

CardsList
  1. Multi-User Dueling Bandits: A Fair Approach using Nash Social Welfare

    May 3, 2026Maheed H. Ahmed, Mahsa GhasemiPairwise Preference LearningMulti-Armed Bandits

  2. Analysis of Search Heuristics in the Multi-Armed Bandit Setting

    Apr 9, 2026Jasmin Brandt, Barbara Hammer, Timo Kötzing +1Multi-Armed BanditsExploration-Exploitation Tradeoff