cs.MAFeb 18, 2026

Evaluating Collective Behaviour of Hundreds of LLM Agents

Authors: Richard WillisJianing ZhaoYali DuJoel Z. Leibo

Organizations: King’s College London London, United Kingdom · King’s College London · Turing Institute · Google DeepMind

Abstract

LLM-powered AI assistants acting on behalf of users can produce poor collective outcomes at scale. We introduce a framework for evaluating their emergent behaviour in social dilemmas, applied to three iterated games (Public Goods, Collective Risk, Common Pool Resource). We prompt each model to produce a natural-language strategy, then have the same model translate it into code. This aims to isolate strategic reasoning from input-parsing, enables pre-deployment inspection, and scales to populations of hundreds of agents. We propose three analyses: behavioural fingerprinting via exhaustive evaluation over opponent histories; self-play robustness across mixtures of a model's strategies with either a Selfish or Collective disposition; and cultural evolution under payoff-biased imitation. Applied to three state-of-the-art LLMs, we find substantial cross-model differences in self-play welfare, and that cultural evolution converges to low-welfare, Selfish-dominant equilibria in larger groups.

Explore similar work

CardsList
  1. Collective cooperation without individual fidelity in LLM agents

    Jun 29, 2026Henrique Ferraz de Arruda, Carlos Gracia Lázaro, Alberto Aleta +1Large Language Model AgentsCooperation