cs.DSAug 15, 2026

A Deterministic Constant-Competitive Algorithm for Dynamic Mixture-of-Experts Serving

Authors: Ian D'Ambrosio

Organizations: Nth Research Collective

Abstract

Dynamic Mixture-of-Experts Serving allocates k replica GPUs among m experts as workloads change. At each round, the online algorithm sees the current workload, chooses integral replica counts, and pays bottleneck service cost plus replica movement. It does not know future workloads. Huang, Lou, and Xiao gave an O(sqrt(log k))-competitive randomized algorithm for this problem. We prove a deterministic O(1)-competitive algorithm. For every number of experts and every k>=1, the algorithm satisfies ALG_det <= 10 C_PB OPT + (5 C_PB + 8) k + 16, where C_PB is the absolute constant from Chasing Positive Bodies at resource augmentation one and covering sparsity two. Consequently, CR_det(k)<=10 C_PB for every k>=1, so CR_det(k)=Theta(1). The multiplicative factor does not depend on the number of experts, replica budget, horizon, or workload values. Thus randomization is not needed for the asymptotic guarantee. The proof has two layers. A finite tangent envelope, summable positive resets, and a nonexpansive balanced projection reduce reciprocal-max service costs to a deterministic exact-budget fractional path. A new deterministic rounding theorem converts every such path to integral allocations with service distortion three and movement bounded by the fractional movement plus 6k. The complete reduction, rounding theorem, causal composition, and quantified main theorem are machine-checked in Lean 4 relative to the positive-body result as the sole scientific source premise. The theorem concerns the allocation model above. It does not include network topology, shared-edge congestion, or routing decisions.

Explore similar work

Oct 9, 2026

Simultaneous Competitive and Regret Guarantees for TCP Acknowledgment

We study simultaneous competitive and regret guarantees for TCP acknowledgment. Each acknowledgment serves all pending packets, and the objective is to minimize the total acknowledgment and waiting costs. It is well known that no deterministic online algorithm achieves a competitive ratio better than 22. Given kk randomized online experts and 0<ε<10<\varepsilon<1, we construct a randomized online algorithm whose realized total cost is always at most (2+ε)(2+\varepsilon) times the offline optimal cost OPT\mathrm{OPT} and whose expected regret against the expert with the smallest realized cost is O(OPTlog⁡(k+1)+log⁡(1/ε))O(\sqrt{\mathrm{OPT}\log(k+1)}+\log(1/\varepsilon)). The algorithm requires no advance knowledge of the number of packets or OPT\mathrm{OPT}. Our algorithm controls switching costs between experts and uses the gap between the permitted competitive bound and its current cost to determine when to learn. We also prove lower bounds showing that, for k≥2k\ge 2, this regret bound is asymptotically optimal in OPT\mathrm{OPT}, kk, and ε\varepsilon, and that ε>0\varepsilon>0 is necessary for sublinear regret.
Oct 8, 2026

Optimally Pacing Budget Spending and Learning

We establish near-optimal regret bounds for budget-constrained online learning against arbitrary classes of budget-pacing experts in the adversarial setting. In particular, given any class of FF experts and a candidate budget pacing schedule, we provide a full-information algorithm which obtains regret O(Dlog⁡F+Tlog⁡F)O(D \sqrt{\log F}+ \sqrt{T\log F}) against all experts whose cumulative spending stays within distance DD of this schedule, matching lower bounds established by Braverman et al. (2025). We additionally show that our technique extends to various problems in online resource allocation, where the learner gets to see the rewards and costs of the current options available to them, and establish O(Dlog⁡F)O(D\sqrt{\log F}) regret bounds when fractional allocation is allowed. This is the first algorithm we are aware of which can achieve o(T)o(\sqrt{T}) guarantees for such tasks.
Aug 17, 2026

Multinomial Subset Routing with Sum-Max Rewards and Operational Constraints

We study online routing to subsets of experts under aggregate bandit feedback and long-run operational constraints. Expert contributions can be complementary: for each task dimension, the best selected expert determines the contribution, and the total reward aggregates these dimension-wise maxima. At the same time, capacity, budget, and fairness requirements impose lower and upper bounds on long-run expert activation frequencies. A fixed deterministic subset cannot generally satisfy such heterogeneous requirements, motivating a stochastic routing policy. We formalize this problem as Multinomial Subset Routing (MSR). The learner maintains a distribution qq over KK experts, samples an expert independently MM times from qq, and routes each task to the distinct sampled experts. We propose OMD-Approachability, which combines online mirror descent with Blackwell's approachability to optimize MSR under two-sided operational constraints. We establish O(T−1/2)O(T^{-1/2}) average reward regret and expected constraint violation. We also quantify the approximation gap induced by a linear surrogate, and evaluate the approach on a real-world crowdsourcing dataset.