cs.CLNov 17, 2026

Bad Apples in the Kitchen: How LLM Teams Detect, Correct, and Calibrate Against Their Misaligned Members

Authors: Dongseok Heo, Junghwan Kim, Bongwon Suh

Organizations: Seoul National University, Seoul, Republic of Korea

Abstract

What protects an LLM team when one teammate quietly goes wrong? Most multi-agent LLM work assumes cooperative partners and inspects chat between turns before acting. Real-time embodied cooperation does not allow this pause: chat runs alongside action, so a teammate whose words stay cooperative while behavior diverges can cause damage faster than the team can name what is happening. We study this case by injecting three theory-grounded misaligned agents into a custom four-player Overcooked environment, each stressing a different joint-action layer (speech-action mismatch, role invasion, and aggregate-progress disruption), and decompose robustness into three sequential gates of detection, correction, and calibration through a 3x4x2 design (n=720 episodes). Nearly all trolls are eventually named, but recovery follows only when attribution and situational diagnosis appear in the same utterance; direct source-attribution prompting improves the hardest case only by degrading the troll-free baseline by 37.5%. Robustness, then, depends less on detection alone than on whether team chat combines attribution with diagnosis in a single utterance, suggesting that sensitivity to misalignment should be targeted rather than uniformly raised.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Be Careful Who You Trust: Coordination Dynamics under Corrupted Communication in LLM Multi-Agent Games

    Sep 19, 2026Xuanyi Liu, Niall Dalton, Hairi Amin +2Multi-Agent CoordinationMulti-Agent LLM Systems

  2. Aligning AI Teams

    Nov 13, 2026Siddarth Srinivasan, Morgan Jane Matthews, Jascha Sohl-Dickstein +1LLM Safety AlignmentMulti-Agent LLMs

  3. Prompted Identity Degrades Cooperation in Multi-Agent LLM Systems

    Sep 28, 2026Xavier Del Giudice, Alessio Palma, Matteo Migliarini +2Multi-Agent LLM SystemsMulti-Agent Coordination