cs.MAJul 29, 2026

Auditing Emergent LLM-Agent Collaboration through Cooperation-Obligation Coupling

Authors: Zuyuan ZhangHanqing YangCarlee Joe-WongTian Lan

Organizations: Department of Electrical and Computer Engineering, The George Washington University · Department of Electrical and Computer Engineering, Carnegie Mellon University

Abstract

LLM-agent systems can solve complex tasks through dynamic self-organization and emergent cooperation. Auditing this process is essential because plausible intermediate or final outputs can conceal incomplete or unsupported work and poorly allocated responsibility, ultimately compromising response quality. While existing approaches may record messages, tool calls, provenance, or task dependencies, an auditability gap exists as they do not jointly represent what work remains, who is responsible for it, and what evidence justifies each work-state transition. We address this auditability gap by proposing \emph{Integrated Cooperation-Obligation REpresentation} (iCORE). It creates a unified encoding X=(G,Q,Π)X=(G,Q,Π) integrating observable interactions as a cooperation graph GG, evolving work and assignments as an obligation graph QQ, and the audit map ΠΠ linking them with verifiable properties and evidence. This iCORE representation enables the auditor to certify two complementary properties: {Work soundness}, where every active decision-relevant work assertion must have a finite justification through GG and ΠΠ; and {Agent-assignment stability}, which requires that no feasible alternative agent improve the declared contribution value for an evaluated obligation by more than εε. We establish local-to-global soundness and assignment-regret guarantees and a performance bound under stated conditions. iCORE is an instrumentation layer over workflows. Numerical results show that the full coupled state exactly reconstructs soundness and assignment defects in two execution modes and that, relative to passive full-state observation, iCORE-Audit yields absolute trajectory-quality improvements of 11.5%11.5\% and 26.4%26.4\% in controlled and real-LLM execution, respectively, with corresponding absolute terminal-performance improvements of 15.1%15.1\% and 31.0%31.0\%.

Explore similar work

CardsList
  1. Auditable Agents

    Apr 7, 2026Yi Nian, Aojie Yuan, Haiyue Zhang +7Algorithm AuditingProduction Agentic Systems