MedHarness: A Unified Budgeted Runtime for Reliable Medical Imaging Agents
Organizations: University of Birmingham
Abstract
Medical imaging agents already return answers on heterogeneous imaging surfaces, yet deployment still faces a limited verification budget where each wrong accept can harm clinical trust. When a thin check and a deeper evidence pass disagree on the same case, deciding when to stop, open more evidence, repair, or reject without a shared controller remains ill-posed. Tool-using workflows often lock a surface-specific evidence order per dataset, or a private always-open full-depth verification path; those pipelines stay costly, leave many wrong accepts, and cannot share one controller across modalities. We present MedHarness, a registered multi-surface runtime reliability layer that reformulates post-answer control as shared decision-object attachment after a proposer's initial prediction. Under Shared Decision Object, Minimum-Sufficient Verification, and Intermediate Repair, one shared policy with surface recipe adapters lets a new imaging surface join the same stop / open-evidence / repair / reject controller by recipe registration. On a 512-case live pool, MedHarness cuts wrong accepts versus a full-verification baseline by about 47% and raises accepted accuracy to 83.2% vs. 72.9% at 86.1% coverage versus full release under that baseline. On a failure-enriched multi-surface stress ranking, the same controller cuts estimated remote service calls per case by about 71% versus that baseline under a matched context-load setting. A held-out three-surface check and an alternate language-model transfer keep the same control ordering. The code is available at https://anonymous.4open.science/r/MedHarness-paper-release-A7F3/.
Figures & tables
| Pools | Surfaces | Arms / Metrics | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Pool | Role | Comp | Surface | Role | Scope | Short | Meaning | Short | Meaning | ||
| All | Attach+replay | 4 surf | 4848 | PAD | Skin repair | skin | 200 | Prop. | Raw proposer floor | Acc. | Correct/accepts |
| Live512 | Stop; HK out | 171/171/170 | 512 | IDRiD | Retinal | 5 DR | 259 | Mono. | Always open alias | Mods. | Module charge |
| Mix4 | Stress+HK | 128 4 | 512 | NEJM | Quiz+know. | quiz | 685 | Always-on | Full evidence open | C/W/Abs. | Correct/wrong/abstain |
| Mix4-HKout | HK-out | 128 3 | 384 | HK | Endoscopy | endo | 3704 | MH | Sparse controller | R/H | Rescue versus harm |
| Live512 surface C%/W% | Live512 Pool | ||||||
|---|---|---|---|---|---|---|---|
| Arm | PAD C%/W% | IDRiD C%/W% | NEJM C%/W% | HK‡ C%/W% | C/W/Abs. | Acc. | Mods. |
| Proposer-only | 76.6/23.4 | 35.7/64.3 | 64.1/35.9 | 43.9/56.1 | 301/211/0 | 0.588 | 0.00 |
| Always-on | 85.4/14.6 | 50.3/49.7 | 82.9/17.1 | 42.2/57.8 | 373/139/0 | 0.729 | 4.00 |
| [][] MedHarness | 83.6/12.3 | 50.3/12.3 | 81.2/18.8 | 93.6/0.0 | 367/74/71 | 0.832 | 3.86 |