When Agent Governance Helps
Organizations: Department of Technology, Leadership, and Innovation, Purdue University, West Lafayette, Indiana, USA
Abstract
No specification says how a governed autotelic AI agent organization, where agents pursue self-generated goals inside guardrails, should be designed and evaluated. We answer in two parts. First, we synthesize the Governed Autotelic Multi-Agent Product Organization (GAMPO) framework from a document-based qualitative evidence synthesis of 321 sources, integrating agency, agile, platform, and governance theory into a runnable specification. Second, we probe a prompt-layer instantiation of GAMPO on CHI-Bench, a long-horizon healthcare benchmark, across open and frontier models. The result is a boundary condition: governance benefit is gated by a model's spare capacity and is domain- and model-specific. On capacity-constrained open models the full procedure yields no reliable benefit, whereas a single "verify your writes" sentence doubles task success (pass@1 2/20 to 4/20). At the frontier the same scaffold lifts prior-authorization 24% to 40% but nets zero on another model, a gap traced to a stable recommendation-override disposition. A second result refines the first: replacing the generic procedure with an answer-blind, per-task definition-of-done, keyed only to the case's own policy and published standards, never the hidden key, raises prior-authorization to 84% under best-of-five self-consistency (68% single-attempt, confirmed by a held-out board) and utilization-management to 44%, while care-management meets a subjective content-quality wall. The contribution is a named, auditable framework and capability-gated evidence that governance should be sized to spare capacity, and that at the frontier a case-grounded specification beats a uniform procedure. Findings are exploratory: partial instantiation, small per-cell samples (n = 5-25), and single trials.
Figures & tables
| Domain | n | pass@1 | Wilson 95% CI |
|---|---|---|---|
| Care-management | 25 | 56% | [37, 73] |
| Prior-authorization | 25 | 40% | [23, 59] |
| Utilization-management | 25 | 16% | [6, 35] |
| Overall | 75 | 37.3% | [27, 49] |
| Model (vendor, scale) | PA base | PA Delta | UM base | UM Delta |
|---|---|---|---|---|
| Gemma, Google (4B effective) | 0.037 | +0.005 | 0.145 | +0.000 |
| Nemotron-3 nano, Nvidia (3B active) | 0.073 | +0.030 | 0.142 | +0.000 |
| gpt-oss, OpenAI (120B) | 0.088 | +0.028 | 0.644 | -0.034 |
| Qwen3.6, Alibaba (35B) | 0.270 | -0.114 | 0.672 | +0.077 |
| Arm | PA frac (Delta) | UM frac (Delta) | Pooled frac | Pass@1 |
|---|---|---|---|---|
| baseline | 0.270 | 0.672 | 0.431 | 2/20 |
| full GAMPO | 0.156 (-0.114) | 0.750 (+0.077) | 0.393 | 1/20 |
| verify-base | 0.403 (+0.133) | 0.870 (+0.198) | 0.590 | 4/20 |
| gampo-lite | 0.289 (+0.019) | 0.761 (+0.088) | 0.478 | 2/20 |
| Model (vendor) | PA Delta | UM Delta | CM Delta |
|---|---|---|---|
| Gemini 3.1 Pro (Google) | +0.056 | -0.248 | n/a |
| Kimi 2.7-code (Moonshot) | +0.056 | -0.021 | -0.188 |
| GPT-5.6-sol (OpenAI) | +0.014 | +0.006 | +0.007 |
| Domain | Baseline | Procedure | Advisory, single-attempt | Advisory, best-of-5 ceiling |
|---|---|---|---|---|
| Prior-authorization | 24% [12, 43] | 40% [23,59] | 68% (17/25) [48,83]* | 84% (21/25) [65,94] |
| Utilization-management | 8% [2,25] | 16% [6,35] | 39.2%** | 44% (11/25) [27,63] |
| Care-management | 40% [23,59] | 56% (14/25) [37,73] | 40% (10/25) [23, 59] | n/a (single-draw) |
| Dimension | From the study | Implication |
|---|---|---|
| People | Judgment-ceiling and deference failures governance cannot fix (clinical override, sign-off) | Keep humans on the non-delegable determinations; scaffolding does not substitute for judgment |
| Process | Govern in proportion to spare capacity; a one-sentence verification beats the full procedure | Make governance capacity-proportional; default to a lightweight verification control, not a comprehensive scaffold |
| Technology | Benefit is gated by model tier, not the scaffold; only the prompt-layer kernel (8 of 26 components) was instrumented | Model selection dominates scaffolding for governed workflows; choose models with spare capacity; the full runtime is now implemented (Figure 12) but its ungated components await end-to-end evaluation |
| Economics | A one-sentence prompt outperforms a 5,200-character procedure on weak models; the filed submission tops out at 37.3% | Govern at the token cost the model can absorb; the benchmark quantifies today’s automation ceiling for these workflows |
AI Agent Governance
AI agent governance studies how to authorize, constrain, monitor, and hold autonomous and multi-agent systems accountable.
See all 442 papers