Paper ID: 2410.06290

Score Design for Multi-Criteria Incentivization

Anmol Kabra, Mina Karzand, Tosca Lechner, Nathan Srebro, Serena Wang

We present a framework for designing scores to summarize performance metrics. Our design has two multi-criteria objectives: (1) improving on scores should improve all performance metrics, and (2) achieving pareto-optimal scores should achieve pareto-optimal metrics. We formulate our design to minimize the dimensionality of scores while satisfying the objectives. We give algorithms to design scores, which are provably minimal under mild assumptions on the structure of performance metrics. This framework draws motivation from real-world practices in hospital rating systems, where misaligned scores and performance metrics lead to unintended consequences.

Submitted: Oct 8, 2024