cs.GTJul 6, 2024

Nash Incentive-compatible Online Mechanism Learning via Weakly Differentially Private Online Learning

Authors: Joon Suk Huh, Kirthevasan Kandasamy

Organizations: Department of Computer Science, University of Wisconsin–Madison

Abstract

We study a multi-round mechanism design problem, where we interact with a set of agents over a sequence of rounds. We wish to design an incentive-compatible (IC) online learning scheme to maximize an application-specific objective within a given class of mechanisms, without prior knowledge of the agents' type distributions. Even if each mechanism in this class is IC in a single round, if an algorithm naively chooses from this class on each round, the entire learning process may not be IC against non-myopic buyers who appear over multiple rounds. On each round, our method randomly chooses between the recommendation of a weakly differentially private online learning algorithm (e.g., Hedge), and a commitment mechanism which penalizes non-truthful behavior. Our method is IC and achieves O(T1+h2)O(T^{\frac{1+h}{2}}) regret for the application-specific objective in an adversarial setting, where hh quantifies the long-sightedness of the agents. When compared to prior work, our approach is conceptually simpler,it applies to general mechanism design problems (beyond auctions), and its regret scales gracefully with the size of the mechanism class.

Figures & tables

Explore similar work

Jul 13, 2025

Efficiency, Feasibility, and Incentive-Awareness in Constrained Online Resource Allocation

We study the dynamic allocation of indivisible resources to strategic agents under long-term constraints, where the planner aims to maximize social welfare, satisfy multiple constraints, and elicit near-truthful reports. We find standard primal-dual methods fragile in this setting: agents easily manipulate their reports to distort dual variables, sacrificing social efficiency for individual utility. To address this, we propose the Incentive-Aware Primal-Dual (IAPD) framework. On the primal side, we integrate three components to suppress manipulation: a VCG-based payment neutralizes immediate misreporting benefits, while epoch-based lazy updates and random exploration together ensure potential future gains are outweighed by immediate penalties. On the dual side, to overcome a learning barrier due to lazy updates -- which we call the "price of incentives" -- we design a novel optimistic online learning algorithm, O-FTRL-FP. It utilizes a fixed-point oracle to resolve the circular dependency between optimistic dual variables and the resulting allocations. Ultimately, our mechanism attains O~(T)\tilde{\mathcal O}(\sqrt T) social welfare regret, satisfies all long-term constraints, and induces a near-truthful equilibrium. It also smoothly generalizes to multi-unit multi-demand allocation problems. Notably, this O~(T)\tilde{\mathcal O}(\sqrt T) regret near-matches the non-strategic Ω(T)Ω(\sqrt T) lower bound, demonstrating that incentive-awareness can be accommodated at nearly no cost.
Sep 17, 2026

Minimax-Optimal Online Contract Design with Unrestricted Bounded Contracts

We study repeated contract design when a principal observes outcomes but not the actions that generate them. The principal may use any bounded outcome-contingent payment vector, and the agent's best response can make expected profit discontinuous in those payments. For every fixed number m≥2m\ge2 of outcomes, the minimax regret over TT rounds is of order Tm/(m+1)T^{m/(m+1)}, up to logarithmic factors. The upper bound allows arbitrary action spaces and agent heterogeneity, without smoothness or monotone-surplus assumptions. Its key is an effective-dimension reduction that the benchmark can be normalized even when fixed tie-breaking is not shift invariant, after which revealed preference yields a monotone response map in payment-difference coordinates. A learning policy built on a Lipschitz parametrization of this map attains the rate using only observed outcome categories. The lower-bound construction accounts for how incentive losses accumulate across outcome dimensions. It shows that each additional contractible outcome creates a precise and unavoidable increase in the worst-case cost of learning.
Oct 21, 2026

Private Online Prediction from Experts with Small Losses

We consider online prediction from experts, a fundamental problem in machine learning, under differential privacy constraints. Existing private algorithms achieve near-optimal regret O~(T)\tilde{O}(\sqrt{T}), where TT is the time horizon. However, this bound becomes suboptimal when L⋆L^\star, the cumulative loss of the best expert, is significantly less than TT. In this work, we present the first differentially private algorithm with regret O~(L⋆)\tilde{O}(\sqrt{L^\star}), offering a substantial improvement in the low-loss regime. Our regret bound matches the non-private lower bound up to poly-logarithmic factors for constant privacy parameters, demonstrating that privacy incurs only a small cost in this setting. Our result assumes that the input sequence is oblivious, i.e., it is fixed in advance and independent of the algorithm's outputs. We also prove that an Ω~(T)\tildeΩ(\sqrt{T}) regret is inevitable for adaptively generated inputs, even when L⋆=0L^\star = 0.