Only as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-Agent
Organizations: Carnegie Mellon University Prosaic Intelligence · University of Southern California Prosaic Intelligence
Abstract
Major industry multi-agent systems like Codex and Claude Code can be broken by attacks that have long been unsuccessful against modern frontier models. AI Safety as a discipline has largely focused on finding the bounds and vulnerabilities of AI models used in isolation. Yet as humans increasingly deploy these models as agents and multi-agent systems, the same attacks that had been thought to be patched when using a model in isolation can break these same models under specific circumstances. We show that these system breaks are not purely theoretical, but can break Claude Code, Codex, and a reference harness, all unmodified and used with their own sub-agent mechanisms. We show the attack by asking agents to answer questions from a store of files on disk in which we have planted a forged record. Searching the store themselves, the strong model orchestrators commit almost zero harmful revisions in over 1,000 trials. However, if that same orchestrator model delegates to a cheaper sub-agent, which is what these harnesses are built to do, the same models on the same facts fail on 20/180, 44/180, 75/180 and 553/900. Thus, even when the system is driven by a strong model, the system's safety lands near the weak reader's, not the orchestrator's. Simulations over 18 models show the same effect in the delivery channel where five aggregators, who on their own were almost never unsafe, repeat a corrupted sub-agent's error in 751/757 trials. The safety of real-world agentic systems that use strong orchestrator agents and weaker sub-agents, and multi-agent systems in general, is defined not by the safety of the strong agent but by the safety of the weakest agent.
Figures & tables
| Harness | Poison | Orch. alone | Weak reader alone | Delegated | Same-tier | |
|---|---|---|---|---|---|---|
| Claude Code | correction | — | — | |||
| Claude Code | correction_clean | — | — | n.s. | ||
| Claude Code | gloss | |||||
| Claude Code | stacked | |||||
| Codex | correction | — | — | |||
| Codex | correction_clean | — | — | n.s. |
Appendix figures & tables10 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Lab | Evidence (95% CI) | Social | Compl. |
|---|---|---|---|---|
| Claude Sonnet 5 | Anthropic | 100% [96,100] | 0% | 100% |
| GPT-5.6-sol | OpenAI | 100% [96,100] | 0% | 100% |
| GPT-5.5 | OpenAI | 99% [95,100] | 1% | 99% |
| Claude Sonnet 4.6 | Anthropic | 93% [86,97] | 1% | 100% |
| Claude Opus 5 | Anthropic | 91% [83,95] | 0% | 100% |
| DeepSeek-V4-Pro | DeepSeek | 89% [81,94] | 17% | 100% |
| Model | No pressure | Peer | Peer + cite | Expert | Expert + cite | Visible E+cite |
|---|---|---|---|---|---|---|
| GPT-3.5-turbo | ||||||
| gpt-4o-mini | ||||||
| GPT-5-nano | ||||||
| GPT-5.4-mini | ||||||
| GPT-5.5 | ||||||
| Claude Haiku 4.5 |
| Model | Baseline | Peer base | Expert base | Expert Peer | Expert cite |
|---|---|---|---|---|---|
| (rate) | ( pp) | ( pp) | ( pp) | ( pp) | |
| GPT-3.5-turbo | 0.0% | +97.2 ∗∗∗ [+94,+99] | +94.4 ∗∗∗ [+91,+98] | -2.8 [-7,+1] | +0.0 [-4,+4] |
| gpt-4o-mini | 18.3% | +25.0 ∗∗∗ [+16,+33] | +79.4 ∗∗∗ [+73,+86] | +54.4 ∗∗∗ [+47,+62] | +0.6 [-1,+2] |
| GPT-5-nano | 0.0% | +0.6 [+0,+2] | +11.7 ∗∗∗ [+7,+17] | +11.1 ∗∗∗ [+6,+16] | -9.4 ∗∗ [-14,-5] |
| GPT-5.4-mini | 0.0% | +0.0 [+0,+0] | +2.2 [+1,+4] | +2.2 [+1,+4] | -2.2 [-4,-1] |
| GPT-5.5 | 0.0% | +0.0 [+0,+0] | +11.1 ∗∗∗ [+7,+16] | +11.1 ∗∗∗ [+7,+16] | -11.1 ∗∗∗ [-16,-7] |
| Aggregator | Clean | Attack | P(err corrupt) | +Verifier | |
|---|---|---|---|---|---|
| Claude Sonnet 5 | 150 | 0% | 98.0% | 1.00 | 0% |
| GPT-5.5 | 180 | 0% | 97.2% | 1.00 | 0% |
| Gemini 2.5 Flash | 150 | 0% | 96.0% | 0.99 | 0% |
| Claude Opus 5 | 150 | 0% | 95.3% | 0.98 | 0% |
| GPT-5.6-sol | 150 | 0% | 94.7% | 0.99 | 0% |
| Pooled | 780 | 0% | 96.3% | — | 0% |
| Orchestrator sub-agent | Tier | Harmful | |
|---|---|---|---|
| Claude Opus 4.6 gpt-oss-20b | weak | ||
| Claude Opus 4.6 GPT-3.5-turbo | weak | ||
| Claude Opus 4.6 gpt-4o-mini | weak | ||
| Claude Sonnet 4.6 gpt-4o-mini | weak | ||
| GPT-5.5 GPT-5-nano | weak | ||
| GPT-5.5 GPT-5.5 | same |
LLM Agent Safety
Large language model agent safety studies how to keep tool-using, persistent, and multi-agent systems aligned with user intent and authorized limits.
See all 358 papers