cs.CLNov 9, 2026

Explaining and interrupting collective misalignment in language model systems

Authors: Edoardo Chidichimo

Organizations: Magdalen College, University of Oxford, UK

Abstract

In collectives, language model agents can exchange individually innocuous messages that together support a policy violation. Understanding and preventing collective misalignment requires answering the question of which messages sufficiently influenced and necessarily enabled the violation. Collective Dependence Analysis (CDA) operationalises necessity and sufficiency to explain decisions and find the fewest removals interrupting support within tested combinations. Tests covered constructed violations, unscripted agent conversations, and recorded interactions, with selected message removals reducing violations from 93% to 6% in controlled cases. Using O(N) model evaluations for N messages, CDA achieves the same violation reduction with half the deletions of a frontier LLM judge given the transcript and asked for all supporting messages in eligible operational cases. CDA also proposes the mechanism through which the collective misalignment emerged. Nonetheless, complete explanations remain difficult on unfamiliar tasks and some removals can inadvertently disrupt correct decisions. CDA unifies explanations of collective misalignment with experimentally tested interventions.

Figures & tables

Explore similar work

CardsList
  1. Alignment Backfire: Language-Dependent Reversal of Safety Interventions Across 16 Languages in LLM Multi-Agent Systems

    Mar 5, 2026Hiroki FukuiLLM SafetyLLM Alignment

  2. Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations

    Aug 23, 2026Isotta Magistrali, Chen ShaniLLM Agent SafetyAI Agent Security