Bandits

Ask about this topic

Momentum

9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 100

All topics
CardsList

  1. Reserve-Aware Contrast Certificates for Conservative Bandits with Uncertain Baselines

    Sep 30, 2026Qinchuan ChengBanditsConservative

    School of Automation Science and Engineering, Xi’an Jiaotong University, Xi’an, China

  2. Bandits with Multiple Optimal Arms: Minimax Regret and Non-Adaptivity

    Sep 29, 2026Kaixuan Ji, Qiwei Di, Qingyue Zhao +2Stochastic Multi-Armed BanditsBandits

    Department of Computer Science, University of California, Los Angeles, CA 90095, USA

  3. Challenges and Solutions for Bandits in the Wild: Warm-Started Mixture Bandits for Cross-Cohort Slate Recommendation

    Sep 29, 2026Serafima Lebedeva, Sumantrak Mukherjee, Ali Arshad Sadal +8RecommendationBandits

    German Research Center for Artificial Intelligence (DFKI), Kaiserslautern · RPTU, Kaiserslautern-Landau · LMU, Munich

  4. Polylogarithmic Nash Regret in Matrix Games with Bandit Feedback

    Sep 28, 2026Yuheng ZhangImperfect-Information GamesBandits

    University of Illinois Urbana-Champaign

  5. Minimax Last-Iterate Convergence in Matrix Games with Observed Actions

    Sep 28, 2026Yuheng ZhangImperfect-Information GamesMinimax

    University of Illinois Urbana-Champaign

  6. Future Information-Directed Sampling for Bayesian Nonstationary Bandits

    Sep 27, 2026Yichen Song, Alessio Russo, Aldo PacchianoBanditsStochastic Exploration

    Boston University · Broad Institute of MIT and Harvard

  7. Bandits with Probing: Optimal Regret and the Limits of Winner Feedback

    Sep 14, 2026Yongjie GuanOptimal RegretMinimax

    Zhejiang University of Technology

  8. Nearly Minimax-Optimal Regret for Linear Contextual Bandits with Arbitrary Adaptive Action Sets

    Sep 14, 2026Tianyuan JinContextual Bandit FrameworkBandits

    Data Science and Analytics Thrust The Hong Kong University of Science and Technology (Guangzhou)

  9. ALIGN-HOLD: Experience Alignment for Real-Time Hold Control in Large-Scale Ride-Hailing Matching at DiDi

    Sep 9, 2026Zuhao Zhang, Xu Liu, Kai Wan +3Bike-Sharing SystemsValue Alignment

    Didichuxing Co. Ltd Beijing, China · Shanghai Jiao Tong University Shanghai, China

  10. Bandits in Prod: Hyperparameter Optimization at Inference Time

    Sep 1, 2026Louis Abraham, Tuan-Anh Nguyen, Nicolas DevatineGeneral Grid Search FrameworkAgentic Optimization

    Tiime Paris, France

  11. Designing for the Next Click: Bandits for Real-Time Page Layout

    Aug 30, 2026Bhavtosh Rath, Harshith Narasimhamurthy, Bob Eisinger +3LayoutsBandits

    Target Corporation Minneapolis, MN, USA · Target Corporation Minneapolis, MN USA

  12. From Relaxed Indexability to Exact Indexability: A tt-Step Approach for Partially Observable Restless Bandits

    Aug 25, 2026Qizhen Jia, Keqin LiuStochastic Multi-Armed BanditsOptimal Policies

    School of Mathematics and Physics · Xi’an Jiaotong-Liverpool University · Suzhou 215123, China

  13. Improved Regret Analysis for Parallel Gaussian Process Bandit Optimization

    Aug 17, 2026Shion Takeno, Shogo IwazakiGaussian ProcessThompson Sampling

    Nagoya University · MI-6 Ltd.

  14. DCM Bandits: Multiplayer Information Asymmetric Cascading Bandits for Multiple Clicks

    Aug 12, 2026Andy Wang, Charlton Shih, William ChangBanditsInformation Asymmetry

    Department of Mathematics University of California, Los Angeles Los Angeles, USA

  15. Robust Multi-Agent Bandits with Heavy-Tailed Rewards and Information Asymmetry

    Aug 11, 2026Daphne Feng, Ricardo Parada, Lily Jiang +2Stochastic Multi-Armed BanditsMulti-Agent Reinforcement Learning

    Department of Mathematics, University of California, Los Angeles, Los Angeles, CA, USA · Department of Mathematics, University of California, Riverside, Riverside, CA, USA

  16. Cost-Aware Multi-Objective Bandits: Theory and Application to Budgeted LLM Configuration Evaluation

    Aug 5, 2026Bo Xue, Zhi Hong, Jiayi Li +3Cost-AwareLarge Language Model Evaluation

    City University of Hong Kong · South China University of Technology · Zhejiang University

  17. Efficient Online Lexicographic Generalized Low-Rank Matrix Bandits

    Aug 5, 2026Bo Xue, Ji Cheng, Haodong Jing +2BanditsSubspace

    City University of Hong Kong. · Xi’an Jiaotong University. · Northwestern Polytechnical University.

  18. LLM-Derived Priors for Thompson Sampling in Cold-Start Comment Recommendation

    Aug 4, 2026Eugene Lee, Oseong Choi, Byungsoo Kang +1Thompson SamplingLarge Language Model Personalization

    NAVER WEBTOON South Korea

  19. Parameter-Free Heavy-Tailed Bandits

    Jul 31, 2026Gianmarco Genalti, Alberto Maria MetelliLong-Tailed DistributionBandits

    Politecnico di Milano

  20. The Greedy Advantage in Finite-Horizon Bandits

    Jul 31, 2026Kai Zhou, Michael Lingzhi Li, Kai WangStochastic Multi-Armed BanditsInterval Regret

    Tsinghua University · Harvard Business School

  21. RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

    Jul 31, 2026Haoran Ling, Yuecheng Li, Zeyu Song +5Prompt OptimizationBandits

    Georgia Institute of Technology · Kuaishou Technology, China

  22. Efficiency Matters in Autonomous Research

    Jul 27, 2026Haiqian Yang, Yuan CaoResearch AutomationSearch Algorithms

  23. Outcome-Fair Restless Multi-Armed Bandits for Stochastic Deadline Scheduling

    Jul 26, 2026Shakti Sharma, Rahul MeshramStochastic Multi-Armed BanditsAlgorithmic Fairness

    Dept. of Physics, IIT Madras, Chennai, India. · Dept. of Electrical Engineering, IIT Madras, Chennai, India.

  24. Breaking the Total Variance Barrier: Sharp Sample Complexity for Linear Heteroscedastic Bandits with Fixed Action Set

    Jul 26, 2026Heyang Zhao, Tianyuan Jin, Weixin Wang +3Stochastic Multi-Armed BanditsVariance Reduction

    Department of Computer Science, University of California, Los Angeles · Department of Electrical and Computer Engineering, National University of Singapore · Department of Biostatistics & Bioinformatics, Duke University +2

  25. Periodic Bootstrap Thompson Sampling For Periodically Non-Stationary Bandit Problems

    Jul 18, 2026Boning ShaoThompson SamplingBandits

    Faculty of Science, University of Hong Kong, Hong Kong, China

  26. Price of Fairness in Bandits: A Tight Minimax Characterization

    Jul 15, 2026Dhruv Sarkar, Soumyadeep Dutta, Sayak Ray ChowdhuryBanditsMinimax

    1Indian Institute of Technology Kharagpur · 2Mohamed bin Zayed University of Artificial Intelligence · 3Indian Institute of Technology Kanpur

  27. Diversified Multinomial Logit Contextual Bandits

    Jul 13, 2026Heesang Ann, Taehyun Hwang, Min-hwan OhAssortmentStochastic Multi-Armed Bandits

    Seoul National University

  28. Learning from Local Walks on Dynamic Graphs with Bandit Feedback

    Jul 12, 2026Sourav Chakraborty, Amit Kiran Rege, Claire Monteleoni +1Stochastic Multi-Armed BanditsBandits

    Department of Computer Science, University of Colorado, Boulder, CO 80309, USA · INRIA, Paris, France

  29. Optimal Top-kk Identification from Pairwise Comparisons

    Jul 9, 2026Motti Goldberger, Nils RudiTop-KActive Learning

    Yale University, New Haven, CT, USA.

  30. Contextual Procurement Auctions with Bandit Learning

    Jul 7, 2026Yiling Chen, Shi Feng, Sadie ZhaoFirst-Price AuctionsContextual Bandit Framework

    Harvard University

  31. Balancing Expressivity and Learnability in Quantum Kernel Bandit Optimization

    Jul 1, 2026Yuqi Huang, Vincent Y. F. Tan, Sharu Theresa JoseQuantum KernelsVariational Quantum Algorithms

    Department of Mathematics, National University of Singapore, Singapore · Department of Electrical and Computer Engineering, National University of Singapore, Singapore · School of Computer Science, University of Birmingham, Birmingham, United Kingdom

  32. Distributed Online Bandit Submodular Maximization with Bounded Sampling Violations

    Jul 1, 2026Bin Du, Chang Liu, Dingqi Zhu +2Submodular FunctionsBandits

    College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China · School of Artificial Intelligence and Automation at the Huazhong University of Science and Technology, Wuhan, China · School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN 47906, USA

  33. A Contextual-Bandit Oversight Game with Two-Sided Informational Asymmetry

    Jun 30, 2026Yunjin TongContextual Bandit FrameworkInformation Asymmetry

    Stanford Graduate School of Business

  34. Learning to Bid in Discriminatory Auctions with Budget Constraints

    Jun 28, 2026Negin Golrezaei, Sourav SahooFirst-Price AuctionsBidding

    Sloan School of Management, Massachusetts Institute of Technology · Operations Research Center, Massachusetts Institute of Technology

  35. A Linear Matching Bandit Approach to Online Multi-Human Multi-Robot Teaming

    Jun 28, 2026Yaohui Guo, X. Jessie Yang, Cong ShiDistribution MatchingMulti-Robot Systems

    Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI 48105

  36. Analysis of Parameter Settings for the Bat Algorithm Using Variance Evolution

    Jun 26, 2026Xin-She Yang, Mehmet KaramanogluEvolutionary OptimizationGenetic Algorithms

    Faculty of Science and Technology, Middlesex University, The Burroughs, London NW4 4BT, United Kingdom.

  37. Jailbreaking for the Average Jane: Choosing Optimal Jailbreaks via Bandit Algorithms for Automatically Enhanced Queries

    Jun 25, 2026Prarabdh Shukla, Ritik, Suhas Rao +2Jailbreak AttacksMalicious Agents

    Centre for Machine Intelligence and Data Science, IIT Bombay · Department of Computer Science and Engineering, IIT Bombay

  38. Capacity-Constrained Online Convex Optimization with Delayed Feedback

    Jun 10, 2026Alexander Ryabchenko, Idan Attias, Daniel M. Roy\Widetilde{\Mathcal{O}}(\Sqrt{T})$ RegretNonconvex

    Department of Statistical Sciences, University of Toronto; Vector Institute. · Institute for Data, Econometrics, Algorithms, and Learning (IDEAL), hosted by UIC and TTIC.

  39. Bandits for Efficient Experimentation: Adapting to Control Group, Preferences, and Context Drifts

    Jun 8, 2026Udvas Das, Waris Radji, Debabrota Basu +1BanditsPreference Alignment Learning

    Univ. Lille, Inria, CNRS, Centrale Lille, UMR 9189 – CRIStAL F-59000 Lille, France

  40. Constrained user-item allocation for e-commerce marketing campaigns

    Jun 8, 2026Maja Lindström, Natalija Glisovic, Jan von Pichowski +2Sales LeadUser Modeling

    Department of Computing Science Integrated Science Lab Umeå University SE-901 87 Umeå, Sweden · KTH Royal Institute of Technology Stockholm, SE-114 28, Sweden · Chair of Machine Learning for Complex Networks Center for Artificial Intelligence and Data Science (CAIDAS) University of Würzburg DE-97070 Würzburg, Germany +2

  41. Cutting LLM Evaluation Costs with SySRs: A Bandit Algorithm that Provably Exploits Model Similarity

    Jun 5, 2026Zifan Lyu, Chahine Nejma, Tobias Wegel +2Similarity and MetricsBandits

    1ETH Zurich · 2Centrale Sup´elec · 3ENS de Cachan +1

  42. Adaptive Learning Rates with Surrogate Probability for Follow-the-Perturbed-Leader

    Jun 4, 2026Jongyeong Lee, Junya Honda, Shinji Ito +1Learning-Augmented AlgorithmsOptimistic Follow-The-Regularized-Leader

    Korea Institute of Science and Technology · Kyoto University · RIKEN AIP +2

  43. Mean-based algorithms: A lower bound and regret

    Jun 3, 2026Julius Durmann, Amelie KleberBanditsNash Equilibrium

    Technical University of Munich

  44. Fairness in two-player zero-sum games with bandit feedback

    May 31, 2026S Akash, Pratik GajaneImperfect-Information GamesBandits

    LatentForce.ai Bengaluru, India · Laboratoire d’Informatique Fondamentale d’Orléans University of Orléans, France

  45. Bandit Simulation for Average Reward Inference

    May 30, 2026Samya Praharaj, Chih-Yu Chang, Koulik Khamaru +1BanditsConfidence Intervals

    Rutgers University · Imperial College London

  46. CUPID in the Model Zoo: Online Matchmaking for Selecting Your Dream LLM

    May 30, 2026Son Nguyen, Xinyuan Liu, Ransalu SenanayakeLarge Language Model AlignmentBandits

    School of Computing and Augmented Intelligence, Arizona State University, Tempe, United States of America

  47. Compute Allocation in Evolutionary Search: From Depth-Breadth to Multi-Armed Bandits

    May 28, 2026Sixue Xing, Haoyu He, Kerui Wu +4Evolutionary SearchBandits

    University of Notre Dame · 2Northeastern University · University of Massachusetts Amherst +4

  48. Adaptive Bandit Algorithms for Contextual Matching Markets

    May 27, 2026Shiyun Lin, Simon Mauras, Vianney Perchet +1Stochastic Multi-Armed BanditsBandits

    Center for Statistical Science, School of Mathematical Sciences, Peking University · INRIA, FairPlay Joint Team · CREST, ENSAE, IP Paris; Criteo AI lab, FairPlay Joint Team +1

  49. Learning to Orchestrate Agents under Uncertainty

    May 26, 2026Mary Chriselda Antony Oliver, Lan Jiang, Aaron Bundi Anampiu +3Multi-Agent OrchestrationOrchestration

    Department of Applied Mathematics and Theoretical Physics, University of Cambridge · Centre for Human-Inspired Artificial Intelligence, University of Cambridge · African Institute for Mathematical Sciences, South Africa +1

  50. Near-Optimal Regret in Adversarial Kernel Bandits

    May 26, 2026Yu-Jie Zhang, Hao Qiu, Jonathan Scarlett +1\Widetilde{\Mathcal{O}}(\Sqrt{T})$ RegretMinimax Rate

    National University of Singapore

  51. Linear and Neural Dueling Bandits with Delayed Feedback

    May 26, 2026Xiangyi Wang, Pingchen Lu, Jie Mao +4Contextual Bandit FrameworkBandits

    The Chinese University of Hong Kong, Shenzhen · The Chi- nese University of Hong Kong

  52. Online Learning on Hidden-Convex Losses via Algorithmic Equivalence: Optimal Regret, Geometric Barrier, and Bandit Feedback

    May 25, 2026Anas Barakat, Andreas Kontogiannis, Vasilis Pollatos +2Convex Loss\Widetilde{\Mathcal{O}}(\Sqrt{T})$ Regret

    Singapore University of Technology and Design · National Technical University of Athens · Archimedes, Athena Research Center, Greece +3

  53. PAC Learning with Bandit Feedback: Sharp Sample Complexity in the Realizable Setting

    May 25, 2026Steve Hanneke, Qinglin Meng, Shay Moran +1Sample ComplexityBandits

    Department of Computer Science Purdue University West Lafayette, IN, USA · Faculties of Mathematics, Computer Science, and Data and Decision Sciences Technion – Israel Institute of Technology and Google Research Haifa, Israel

  54. Nonstationary Generalized Linear Bandits with Discounted Online Mirror Descent

    May 25, 2026Joongkyu Lee, Min-hwan OhMirror DescentBandits

    Seoul National University

  55. Prudent-Banker: No Extra Fees for Baseline Safety in Adversarial Bandits With and Without Delays

    May 22, 2026Ting Hu, Luanda Cai, Emmanouil-Vasileios Vlatakis-GkaragkounisBanditsBounded Adversary

    Department of Finance University of Wisconsin–Madison · Department of Computer Sciences University of Wisconsin–Madison

  56. Pure Exploration for a Good Policy in Reinforcement Learning with Bandit Feedback

    May 22, 2026Zitian Li, Wang Chi CheungBanditsOptimality

    Department of Industrial Systems Engineering & Management National University of Singapore Engineering Drive 2 Block E1A #06-25 Singapore 117576

  57. Bandit Convex Optimization with Gradient Prediction Adaptivity

    May 21, 2026Shuche Wang, Adarsh Barik, Vincent Y. F. TanConvex LossConvex Optimization

    Department of Mathematics, National University of Singapore, Singapore · Department of Computer Science and Engineering, Indian Institute of Technology Delhi, India · Department of Electrical and Computer Engineering, National University of Singapore, Singapore

  58. Spectral bandits for smooth graph functions with applications in recommender systems

    May 19, 2026Tomáš Kocák, Michal Valko, Rémi Munos +2Real-World Content Recommendation ProblemBandits

    SequeL team Inria Lille France · SequeL team, Inria France · Microsoft Research New England +2

  59. Catching a Moving Subspace: Low-Rank Bandits Beyond Stationarity

    May 18, 2026Hamed Khosravi, Xiaoming HuoContextual Bandit FrameworkBandits

    H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332

  60. Don't Let Bandit Feedback Pull Continual LLM-Recommender Updates Off Target

    May 17, 2026Taesan Kim, Hyeongjun Yun, Jaegul Choo +1Sequential RecommendationContextual Bandit Framework

    1SK Telecom · 2KAIST