Online Resource Allocation

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 17% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 65

All topics

SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling
Jul 9, 2026Jiahao Wang, Kaizhan Lin, Kaixi Zhang +7LLM Inference Scheduling KV-Cache Management
Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University · ShanghaiTech University · Alibaba Group
Latency-Aware Bid Acceptance under Operational Feasibility: A Public Benchmark with Hindsight Ceilings
Jul 8, 2026Aswin ChandrasekaranBenchmark Design Vehicle Routing
Bubba AI
Online Linear Programming for Multi-Objective Routing in LLM Serving
Jul 4, 2026Zixi Chen, Yinyu Ye, Zijie ZhouLLM Serving LLM Routing
School of Mathematical Sciences, Peking University · Department of Industrial Engineering and Decision Analytics, HKUST
Metronome: Bound the Cache, Keep the Beat for Real-Time Interaction Model Serving
Jul 2, 2026Jiaying Meng, Bojie LiLLM Serving KV Caching
Independent Researcher · Pine AI
Online Resource Allocation with Continuous Random Consumption: Regret under Degeneracy
Jul 2, 2026Jiawei ZhangRegret Minimization Online Resource Allocation
Stern School of Business New York University
Tight Lower Bounds for the Multi-Secretary Problem via Bellman Certificates
Jul 2, 2026Jiawei ZhangRegret Minimization Online Resource Allocation
Department of Technologies, Operations, and Statistics Stern School of Business, New York University
Congestion-Based Slot Pricing in a Railway Auction Game
Jul 2, 2026Bill Roungas, Sebastiaan MeijerMechanism Design Game-Playing Agents
Panteion University, Athens, Greece · Institute of Communication and Computer Systems, Athens, Greece · KTH Royal Institute of Technology, Stockholm, Sweden
ROSA: A Robotics Foundation Model Serving System for Robot Factories
Jul 1, 2026Wenqi Jiang, Jason Clemons, Rowland O'Flaherty +5Multi-Robot Systems Robot Foundation Models
NVIDIA Research · Stanford University
Learning to Bid in Discriminatory Auctions with Budget Constraints
Jun 28, 2026Negin Golrezaei, Sourav SahooGame Theory Automated Bidding
Sloan School of Management, Massachusetts Institute of Technology · Operations Research Center, Massachusetts Institute of Technology
WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware
Jun 20, 2026Jiamu Zhang, Liang Wu, Mayank Darbari +1Expert Offloading Mixture-of-Experts Inference
Nokia, Sunnyvale, CA 94085, USA
Fair Online Resource Allocation
Jun 17, 2026Christopher En, Yuri Faenza, Andrea Lodi +1Sequential Decision Making Fair Resource Allocation
Columbia University, IEOR Department · Cornell Tech · Universidad de Chile
ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models
Jun 9, 2026Wenhao Liu, Hao Shi, Yunhe Li +7KV Caching Memory-Efficient Optimization
1Tsinghua University · 2City University of Hong Kong · 3Peking University +2
Trading Utility for Dynamic Fairness in Multiple Resource Division with Sequential Demand
Jun 9, 2026Kaiqi Jiang, Karim El Husseini, Wenzhe Fan +1Sequential Decision Making Fair Resource Allocation
Computer Science Dept., University of Illinois Chicago, Chicago, Illinois, USA
HMAF: A Hierarchical Multi-Slot GD-RTB Allocation Framework
Jun 4, 2026Tianxing Bu, Zhaoqi Zhang, Linyou Cai +7Online Advertising Online Resource Allocation
Meituan Beijing, China · Nanyang Technological University Singapore · China Agricultural University Beijing, China
Cross-Epoch Adaptive Rollout Optimization for RL Post-Training
Jun 4, 2026Yiming Zong, Yige Wang, Jiashuo JiangSequential Decision Making RL for Language Model Reasoning
Department of Industrial Engineering & Decision Analytics, Hong Kong University of Science and Technology
Autonomic Federated-Market Orchestration for the Edge-Cloud Continuum
May 26, 2026Lauri Lovén, Roberto Morabito, Abhishek Kumar +3Multi-Agent Orchestration Online Resource Allocation
Future Computing Group, University of Oulu, Finland · EURECOM, France · University of Jyväskylä, Finland +2
When Does Deep RL Beat Calibrated Baselines? A Benchmark Study on Adaptive Resource Control
May 26, 2026Guilin Zhang, Chuanyi Sun, Kai Zhao +3RL Control RL Benchmarks
The George Washington University, Washington, DC, USA
STARIXNet: Multivariate and Multi-attribute Deep Learning Approach to Real-Time Resource Allocation in Cloud Platforms
May 25, 2026Ahmed Abdulaal, Maruf Aytekin, Thilaga kumaran Srinivasan +1Multivariate Time Series Forecasting Cloud Computing
Walmart Global Tech Sunnyvale, California, USA
Optimal and Order-optimal Gated Priority-based Greedy Policies for Two-layer Multi-item Order Fulfillment
May 25, 2026Xi Chen, Yuze Chen, Ziyi Chen +1Inventory Control Competitive Analysis
Leonard N. Stern School of Business, New York University, New York, NY 10012, USA · Qiuzhen College, Tsinghua University, Beijing 100084, China · Yau Mathematical Sciences Center & Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China
Online Allocation with Unknown Shared Supply
May 8, 2026Tzeh Yuan Neoh, Davin Choo, Mengchu Yue +1Inventory Control Sequential Decision Making
Harvard University
On Time, Within Budget: Constraint-Driven Online Resource Allocation for Agentic Workflows
May 7, 2026Xinglin Wang, Zishen Liu, Shaoxiong Feng +9Stochastic Optimization Cost-Aware Inference
School of Computer Science, Beijing Institute of Technology · Xiaohongshu Inc
One Pool, Two Caches: Adaptive HBM Partitioning for Accelerating Generative Recommender Serving
May 6, 2026Wenjun Yu, Shuguang Han, Amelie Chi ZhouLLM Inference Efficiency GPU Acceleration
Hong Kong Baptist University · Hong Kong, China · Alibaba Inc +1
Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs
May 5, 2026Yixuan Mei, Zikun Li, Zixuan Chen +5LLM Serving Cost-Aware Inference
Carnegie Mellon University · Peking University
Budget-Constrained Causal Bandits: Bridging Uplift Modeling and Sequential Decision-Making
Apr 28, 2026Abhirami PillaiMulti-Armed Bandits Causal Effect Estimation
utdallas
Extreme bandits
Apr 27, 2026Alexandra Carpentier, Michal ValkoMulti-Armed Bandits Exploration-Exploitation Tradeoff
Statistical Laboratory, CMS University of Cambridge, UK · SequeL team INRIA Lille - Nord Europe, France
SMaRT: Online Reusable Resource Assignment and an Application to Mediation in the Kenyan Judiciary
Feb 20, 2026Shafkat Farabi, Didac Marti Pinto, Wei Lu +4Sequential Decision Making Online Resource Allocation
Virginia Tech · University College London · The World Bank
Online Generalized-Mean Welfare Maximization: Achieving Near-Optimal Regret from Samples
Feb 11, 2026Zongjun Yang, Rachitesh Kumar, Christian KroerFair Resource Allocation Online Resource Allocation
Columbia University · Carnegie Mellon University
AdaSwitch: An Adaptive Switching Meta-Algorithm for Learning-Augmented Bounded-Influence Problems
Sep 2, 2025Xi Chen, Yuze Chen, Shibo Dai +1Learning-Augmented Algorithms Algorithm Selection
Yau Mathematical Sciences Center & Department of Mathematical Sciences, Tsinghua University, Beijing 100084, China, Beijing Institute of Mathematical Sciences and Applications, Beijing 101408, China
AEGIS: Runtime-Guided GPU Collocation for Multi-Tenant Deep Learning Training
Aug 26, 2025Ehsan Yousefzadeh-Asl-Miandoab, Büşra Karatay Demiray, Florina M. Ciorba +2Real-Time Scheduling Online Resource Allocation
IT University of Copenhagen Denmark · University of Basel Switzerland
Efficiency, Feasibility, and Incentive-Awareness in Constrained Online Resource Allocation
Jul 13, 2025Yan Dai, Negin Golrezaei, Patrick JailletPrimal-Dual Optimization Online Convex Optimization
Operations Research Center, MIT. · Sloan School of Management, MIT. · Department of EECS, MIT.

Jul 9, 2026, cs.DCJ/K move · Enter open · S save

SMetric: Rethink LLM Scheduling for Serving Agents with Balanced Session-centric Scheduling

Jiahao Wang, Kaizhan Lin, Kaixi Zhang, Jinbo Han+6

Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University · ShanghaiTech University · Alibaba Group

LLM Inference Scheduling KV-Cache Management LLM Inference Serving LLM Agent Serving Online Resource Allocation

Open paper AskPDF arXiv

LLM scheduling is critical to serving, yet it remains unclear how well existing designs fit agentic serving--with LLM requests issued by agents instead of humans. This shifts the workload in two ways: (1) agents act only on complete responses, making the cluster's tokens per second (TPS) the primary goal and relaxing--not eliminating--per-token latency requirements; and (2) requests share much of their KV$-reuse exceeds 80% of request tokens in a production trace from BAILIAN, versus 54-62% in chat. This paper first contributes a systematic study of request scheduling for agents on two real-world traces. We find that to increase KV$ reuse, existing schedulers overly prioritize routing requests to instances caching their KV$, overloading a few while leaving the rest idle, capping TPS. We thus present two key insights: (1) load balance need not sacrifice all KV$ reuse, thanks to the global-tier KV$ store and (2) by utilizing the workload's intra-session locality, balancing a small fraction of requests--the first request in each agent session--suffices to balance the cluster without sacrificing most KV$ reuse on local instances. SMETRIC realizes these insights with balanced session-centric scheduling: it routes each session's first request purely for load balance and its follow-up requests in a cache-aware manner, preserving load balance and local reuse while keeping demand on the global tier low. Using the session turn information as the scheduling metric is deliberate: it is derived efficiently and accurately from the user inputs alone, so the scheduler stays clean and stateless. SMETRIC improves cluster TPS by 10-16% under prefill-decode colocation with a global store and prefill TPS by 2-34% under disaggregation over state-of-the-art schedulers, also with a better per-token latency.

Momentum

Related topics

Latest papers 65