Contextual Bandit Framework

Ask about this topic

Momentum

5 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 57

All topics
CardsList

  1. Variance-Optimal Off-Policy Evaluation with Conjunct Effect Modeling

    Oct 6, 2026Nicolò Felicioni, Michael Benigni, Maurizio Ferrari Dacrema +1Contextual Bandit FrameworkOff-Policy Learning

    Spotify · Politecnico di Milano

  2. The Surrogate Is Not the Reward: Post-Surrogate Primary-Outcome Acquisition in Contextual Bandits

    Oct 5, 2026Kyungbok Lee, Michael R. KosorokContextual Bandit Framework

    Department of Biostatistics University of North Carolina at Chapel Hill Chapel Hill, NC 27599-7420, USA

  3. Vanilla Policy Optimization Is Both Optimal and Differentially Private for Stochastic Contextual Bandits

    Sep 27, 2026Idan Attias, Orin Levy, Alexander Ryabchenko +2Contextual Bandit FrameworkEfficient Exploration

    University of Illinois Chicago · Toyota Technological Institute at Chicago · Tel Aviv University +3

  4. Efficient Linear Bandits via Cluster-Aware Sketching

    Sep 23, 2026Hantao Yang, Hong Xie, Defu LianContextual Bandit Framework

    University of Science and Technology of China

  5. Nearly Minimax-Optimal Regret for Linear Contextual Bandits with Arbitrary Adaptive Action Sets

    Sep 14, 2026Tianyuan JinContextual Bandit FrameworkBandits

    Data Science and Analytics Thrust The Hong Kong University of Science and Technology (Guangzhou)

  6. When Greedy Sampling Explores: KL-Regularized Contextual Bandits without Eluder-Dimension Dependence

    Sep 11, 2026Zichen Wang, Haoyang Hong, Huazheng WangContextual Bandit FrameworkKullback-Leibler Regularization

    Department of ECE and CSL, University of Illinois Urbana-Champaign · School of Electrical Engineering and Computer Science, Oregon State University

  7. Meta-LinEXP3: Online-within-Online Learning for Adversarial Linear Contextual Bandits

    Sep 9, 2026Hao Li, Jie Xu, Zheng XieContextual Bandit FrameworkMeta-Learning

    College of Science, National University of Defense Technology, Changsha 410073, China

  8. When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits

    Aug 12, 2026Sang Su Lee, Vineeth Loganathan, Shishir Dash +1Contextual Bandit FrameworkPersonalization

    Thumbtack, Inc. San Francisco, CA, USA

  9. Memory--Batch Tradeoffs in Lipschitz Bandits

    Aug 8, 2026Zicheng Lyu, Zengfeng HuangContextual Bandit FrameworkInformation-Theoretic Limits

    Fudan University Shanghai, China · Fudan University Shanghai Innovation Institute Shanghai, China

  10. Progressive Content Refinement with Decaying Reward Joint LinUCB

    Aug 7, 2026Shion Ishikawa, Pablo Loyola, Young-joo Chung +1Contextual Bandit FrameworkLarge Language Model Reinforcement Learning

    Rakuten Group, Inc. Tokyo, Japan · Rakuten Group, Inc. San Mateo, USA

  11. Bootstrap-Conditioned Action Selection with Tabular Foundation Models

    Aug 6, 2026Devansh Gupta, Shiv Tavker, Dmitry Efimov +3Contextual Bandit FrameworkIn-Context Learning

    Amazon Science

  12. Cross-Domain Off-Policy Evaluation and Learning for Contextual Bandits

    Jul 24, 2026Yuta Natsubori, Masataka Ushiku, Yuta SaitoContextual Bandit FrameworkOff-Policy Learning

    Hakuhodo DY Holdings, Inc. · Cornell University

  13. A Predict-then-Correct Loop Based on Few-Shot Continuous Contextual Bandit for Demand Forecasting

    Jul 17, 2026Zhiwei Lei, Benedict Jun Ma, Ilya JacksonContextual Bandit FrameworkLoop

    Thrust of Intelligent Transportation, Hong Kong University of Science and Technology (Guangzhou), China · Center for Transportation and Logistics, Massachusetts Institute of Technology, USA

  14. Kernel weighted importance sampling for off-policy evaluation in contextual bandits

    Jul 16, 2026Joshua Spear, Matthieu Komorowski, Rebecca Pope +2Contextual Bandit FrameworkImportance Weighting

    Institute of Child Health, University College London · Strive Health Ltd. · National Institute for Health Research +3

  15. Optimal and Efficient Contextual Combinatorial Semi-bandits with General Function Approximation

    Jul 15, 2026Hao Qin, Chicheng ZhangContextual Bandit FrameworkStochastic Multi-Armed Bandits

    The University of Arizona

  16. Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing

    Jul 10, 2026Ajay Narayanan Sridhar, Ronak Singh, Mehrdad Mahdavi +1Contextual Bandit FrameworkLarge Language Model Routing

    The Pennsylvania State University

  17. Contextual Procurement Auctions with Bandit Learning

    Jul 7, 2026Yiling Chen, Shi Feng, Sadie ZhaoFirst-Price AuctionsContextual Bandit Framework

    Harvard University

  18. Dynamic Regret for Non-Stationary Linear Bandits via Misspecification Reductions

    Jul 3, 2026Zihao Hu, Yuan Yao, Jiheng Zhang +1Contextual Bandit FrameworkRegret

    Department of Mathematics, The Hong Kong University of Science and Technology

  19. A Contextual-Bandit Oversight Game with Two-Sided Informational Asymmetry

    Jun 30, 2026Yunjin TongContextual Bandit FrameworkInformation Asymmetry

    Stanford Graduate School of Business

  20. Contextual Slate GLM Bandits with Limited Adaptivity

    Jun 30, 2026Tanmay Goyal, Sukruta Prakash Midigeshi, Gaurav SinhaContextual Bandit FrameworkGeneralized Linear Model

    Microsoft Research India

  21. Graph Dimensionality Reduction for Contextual Bandits: Structure-Specific Regret Bounds under Approximate Smoothness and Noisy Eigenspaces

    Jun 26, 2026Joyanta Jyoti Mondal, Ibne Farabi Shihab, Anuj SharmaContextual Bandit FrameworkDimensionality Reduction

    Department of Computer and Information Sciences, University of Delaware, USA · Department of Computer Science, Iowa State University, USA · Department of Civil, Construction & Environmental Engineering, Iowa State University, USA

  22. A Comparative Study of Bayesian Contextual Bandits for Real-Time Warehouse Sorter Optimization

    Jun 22, 2026Tina Dongxu Li, Mouhacine Benosman, Ken Meszaros +1Bayesian OptimizationContextual Bandit Framework

    Amazon.com, USA

  23. Counterfactual learning of new adaptive instructional policies using logged data

    Jun 22, 2026Samuel Girard, Sein Minn, Amel Bouzeghoub +1Contextual Bandit FrameworkCounterfactual Learning

    SODA · Soda Team, Inria Saclay, Palaiseau, France · Pix, Paris, France +4

  24. Statistical Inference for Misspecified Contextual Bandits

    Jun 21, 2026Yongyi Guo, Ziping XuContextual Bandit FrameworkStatistical Inference

    Department of Statistics, University of Wisconsin–Madison · School of Data Science and Society, University of North Carolina at Chapel Hill

  25. AdaPrivate-TS: Private Thompson Sampling for Contextual Bandits with Privacy Amplification

    Jun 19, 2026Mohammadreza Riyazat, Eranga UkwattaContextual Bandit FrameworkThompson Sampling

    School of Engineering, University of Guelph, Guelph, ON, Canada.

  26. Stochastic Linear Contextual Bandits with Bounded Noise: A Set-Membership Approach

    Jun 18, 2026Haonan Xu, Yingying LiContextual Bandit FrameworkOptimal Regret

    The Grainger College of Engineering University of Illinois Urbana-Champaign Champaign, IL, 61801

  27. Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification

    Jun 4, 2026Haoyang Hong, Zichen Wang, Quanquan Gu +1Contextual Bandit FrameworkRegularization

    School of Electrical Engineering and Computer Science, Oregon State University · Department of Electrical and Computer Engineering and Coordinated Science Laboratory, University of Illinois Urbana-Champaign · Department of Computer Science, University of California, Los Angeles

  28. Offline-to-Online Learning in Linear Bandits

    Jun 3, 2026Kushagra Chandak, Toshinori Kitamura, Xiaoqi TanContextual Bandit Framework

    Department of Computing Science, University of Alberta, Canada

  29. Decision-Focused On-Policy Learning for Contextual Linear Optimization with Partial Feedback

    May 31, 2026Wyame Benslimane, Tinghan Ye, Pascal Van Hentenryck +1Contextual Bandit FrameworkOn-Policy

    Department of Industrial Engineering and Operations Research University of California, Berkeley · H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology

  30. Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter Updates

    May 31, 2026Sanghoon Yu, Min-hwan OhContextual Bandit FrameworkRare Events

    Seoul National University, Seoul, Republic of Korea

  31. Variance-sensitive Thompson sampling for generalised linear bandits, revisited

    May 29, 2026Tom Perneczky, Marc Abeille, David JanzThompson SamplingVariance Reduction

    University of Oxford · Criteo AI Lab

  32. The Sample Complexity of Multiclass and Sparse Contextual Bandits

    May 28, 2026Liad Erez, Fan Chen, Alon Cohen +4Contextual Bandit FrameworkOptimal Sample Complexity

    1Tel Aviv University, Israel · 2Massachusetts Institute of Technology, USA · 3Google Research Tel Aviv, Israel +1

  33. Linear and Neural Dueling Bandits with Delayed Feedback

    May 26, 2026Xiangyi Wang, Pingchen Lu, Jie Mao +4Contextual Bandit FrameworkBandits

    The Chinese University of Hong Kong, Shenzhen · The Chi- nese University of Hong Kong

  34. Active Learning for Stochastic Contextual Linear Bandits

    May 24, 2026Emma Brunskill, Ishani Karmarkar, Zhaoqi LiContextual Bandit FrameworkActive Learning

    Stanford University

  35. Human-in-the-Loop Contextual Bandits for Short-Term Rental Dynamic Pricing: Structural Equivalence of Historical Warm-Up and Approval-Gated Live Learning

    May 22, 2026Oleg MiroshnichenkoDynamic PricingContextual Bandit Framework

  36. Catching a Moving Subspace: Low-Rank Bandits Beyond Stationarity

    May 18, 2026Hamed Khosravi, Xiaoming HuoContextual Bandit FrameworkBandits

    H. Milton Stewart School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332

  37. Offline Contextual Bandits in the Presence of New Actions

    May 18, 2026Ren Kishimoto, Tatsuhiro Shimizu, Kazuki Kawamura +6Contextual Bandit FrameworkOff-Policy Learning

    Institute of Science Tokyo · Yale University · Sony Group Corporation +1

  38. Don't Let Bandit Feedback Pull Continual LLM-Recommender Updates Off Target

    May 17, 2026Taesan Kim, Hyeongjun Yun, Jaegul Choo +1Sequential RecommendationContextual Bandit Framework

    1SK Telecom · 2KAIST

  39. Pessimistic Risk-Aware Policy Learning in Contextual Bandits

    May 15, 2026Yilong Wan, Yuqiang Li, Xianyi WuContextual Bandit FrameworkLipschitz Continuity

  40. Harnessing Unimodality in Semiparametric Contextual Pricing via Oracle Price Map Learning

    May 14, 2026Yingying Fan, Yuxuan Han, Jinchi Lv +2Dynamic PricingContextual Bandit Framework

    Data Sciences and Operations Department, University of Southern California, Los Angeles, California 90089, USA · Stern School of Business, New York University, New York, NY 10003, USA

  41. Contextual Bandits for Resource-Constrained Devices using Probabilistic Learning

    May 13, 2026Marco Angioli, Kevin Johansson, Antonello Rosato +2Contextual Bandit FrameworkResource-Constrained Edge Devices

    Sapienza University of Rome · Orebro University · Linkoping University +1

  42. Signature Approach for Contextual Bandits with Nonlinear and Path-dependent Rewards

    May 11, 2026Xin Guo, Grace He, Xinyu LiContextual Bandit FrameworkBandits

    University of California, Berkeley, Berkeley, CA · University of Oxford, Oxford, UK

  43. Fast Rates for Offline Contextual Bandits with Forward-KL Regularization under Single-Policy Concentrability

    May 9, 2026Qingyue Zhao, Kaixuan Ji, Heyang Zhao +1Kullback-Leibler RegularizationContextual Bandit Framework

    Department of Computer Science, University of California, Los Angeles, CA 90095, USA

  44. Ensemble Distributionally Robust Bayesian Optimisation with Continuous Context

    May 8, 2026Tigran Ramazyan, Denis DerkachDistributionally-Robust OptimizationBayesian Optimization

    Faculty of Computer Science, HSE University, Pokrovsky Boulevard 11, Moscow, 109028, Moscow, Russia.

  45. Constrained Contextual Bandits with Adversarial Contexts

    May 7, 2026Dhruv Sarkar, Abhishek SinhaContextual Bandit FrameworkToken Budget Allocation

    Indian Institute of Technology Kharagpur, India · Tata Institute of Fundamental Research, Mumbai, India

  46. Instance-Level Costs for Nuanced Classifier Evaluation

    May 4, 2026Kabir Kang, Stephen MussmannClassifierEvaluation Metrics

    School of Computer Science, Georgia Institute of Technology, Atlanta, GA, USA.

  47. Robust Linear Dueling Bandits with Post-serving Context under Unknown Delays and Adversarial Corruptions

    May 3, 2026Youngmin OhContextual Bandit FrameworkBandits

    InfiniTree, Republic of Korea

  48. Scaling Federated Linear Contextual Bandits via Sketching

    May 1, 2026Hantao Yang, Hong Xie, Xutong Liu +1Contextual Bandit FrameworkFederated Learning

    University of Science and Technology of China · University of Washington Tacoma

  49. Direction-Aware Offline-to-Online Learning in Linear Contextual Bandits

    Apr 27, 2026Zean Han, Ruihan Lin, Zezhen Ding +1Contextual Bandit FrameworkBandits

    Department of Industrial Engineering and Decision Analytics The Hong Kong University of Science and Technology

  50. Logistic Bandits with O~(dT)\tilde{O}(\sqrt{dT}) Regret without Context Diversity Assumptions

    Apr 24, 2026Seoungbin Bae, Dabeen Lee\Widetilde{\Mathcal{O}}(\Sqrt{T})$ RegretContextual Bandit Framework

    Department of Industrial & Systems Engineering, KAIST · Department of Mathematical Sciences, Seoul National University

  51. Calibration-Gated LLM Pseudo-Observations for Online Contextual Bandits

    Apr 16, 2026Maksim Pershin, Ivan Golovanov, Pavel Baltabaev +1Contextual Bandit FrameworkCounterfactual Learning

  52. Learning When to Trust in Contextual Social Bandits

    Mar 9, 2026Majid Ghasemi, Mark CrowleyContextual Bandit FrameworkAI Trustworthiness

    Department of Electrical & Computer Engineering University of Waterloo, Canada

  53. Taming the Monster Every Context: Complexity Measure and Unified Framework for Offline-Oracle Efficient Contextual Bandits

    Feb 10, 2026Hao Qin, Chicheng ZhangContextual Bandit FrameworkUnified Framework

    The University of Arizona

  54. Learning Peer Influence Probabilities with Linear Contextual Bandits

    Oct 21, 2025Ahmed Sayeed Faruk, Mohammad Shahverdikondori, Elena ZhelevaContextual Bandit FrameworkInfluence Function

    University of Illinois Chicago, Chicago, USA · École Polytechnique Fédérale de Lausanne, Switzerland

  55. Provable Anytime Ensemble Sampling Algorithms in Nonlinear Contextual Bandits

    Oct 12, 2025Jiazheng Sun, Weixin Wang, Pan XuContextual Bandit FrameworkEnsemble

    Duke University

  56. Best-of-Both Worlds for linear contextual bandits with paid observations

    Oct 8, 2025Nathan Boyer, Dorian Baudry, Patrick RebeschiniContextual Bandit FrameworkOptimistic Follow-The-Regularized-Leader

    ENS Paris-Saclay, France · Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LIG, 38000 Grenoble, France · Department of Statistics, University of Oxford

  57. Primal-dual algorithm for contextual stochastic combinatorial optimization

    May 7, 2025Louis Bouvier, Thibault Prunet, Vincent Leclère +1Stochastic OptimizationNeural Combinatorial Optimization

    Co-innovation lab, ENPC, Institut Polytechnique de Paris, Marne-la-Vallée, France · Université de Bordeaux, CNRS, INRIA, IMB, UMR 5251, Talence, France · CERMICS, CNRS, ENPC, Institut Polytechnique de Paris, Marne-la-Vallée, France