cs.AISep 30, 2026

Reserve-Aware Contrast Certificates for Conservative Bandits with Uncertain Baselines

Authors: Qinchuan Cheng

Organizations: School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, China

Abstract

Conservative bandits must improve an incumbent policy without exhausting a prescribed performance budget. When the incumbent is uncertain, separately bounding candidate and baseline rewards can charge twice for shared estimation error. We develop Reserve-C4B around the baseline-relative contrast itself. A shared confidence set yields an exact expression for this avoidable penalty and a tighter admissibility test at every fixed history. A reserve ledger separates statistical evidence from permitted performance deficit; a prefix-refresh extension recertifies accumulated decisions under the current confidence set without discarding previously certified credit. For linear rewards, self-normalized confidence sets provide simultaneous validity over time and adaptively generated candidates, and the resulting policy satisfies a conditional-mean performance constraint with high probability. Reproducible experiments isolate certificate coupling, prefix refresh, and historical information, showing large reductions in baseline fallback while exposing the limitations of frozen certificates.

Figures & tables

Explore similar work

CardsList
  1. A Joint Finite-Sample Certificate for Adaptive Selective Conformal Risk Control

    Jun 7, 2026Xiaoli Yu, Jiamiao LiuConformal Risk ControlFinite-Sample Certificates

  2. Finite Constant Frontiers and Auditable Regret Certificates for Average-Reward Reinforcement Learning

    Aug 7, 2026Ibne Farabi Shihab, Abu Sa-Adat Mohamed Moon-Im Al Ahsan, Md Najmus SwaqeebOptimal LearnerMarkov Decision Processes

  3. Direction-Aware Offline-to-Online Learning in Linear Contextual Bandits

    Apr 27, 2026Zean Han, Ruihan Lin, Zezhen Ding +1Contextual Bandit FrameworkBandits