Do Agent Societies Develop Intellectual Elites? The Hidden Power Laws of Collective Cognition in LLM Multi-Agent Systems
Organizations: Department of Computer Science, Virginia Tech, Blacksburg, VA
Abstract
Large Language Model (LLM) multi-agent systems are increasingly deployed as interacting agent societies, yet scaling these systems often yields diminishing or unstable returns, the causes of which remain poorly understood. We present the first large-scale empirical study of coordination dynamics in LLM-based multi-agent systems, introducing an atomic event-level formulation that reconstructs reasoning as cascades of coordination. Analyzing over 1.5 Million interactions across tasks, topologies, and scales, we uncover three coupled laws: coordination follows heavy-tailed cascades, concentrates via preferential attachment into intellectual elites, and produces increasingly frequent extreme events as system size grows. We show that these effects are coupled through a single structural mechanism: an integration bottleneck, in which coordination expansion scales with system size while consolidation does not, producing large but weakly integrated reasoning processes. To test this mechanism, we introduce Deficit-Triggered Integration (DTI), which selectively increases integration under imbalance. DTI improves performance precisely where coordination fails, without suppressing large-scale reasoning. Together, our results establish quantitative laws of collective cognition and identify coordination structure as a fundamental, previously unmeasured axis for understanding and improving scalable multi-agent intelligence.
Figures & tables
| Tail statistics | Model comparison | ||||||||||
| Observable | Tail family | Distinct | LR (TPL vs LN) | LR (TPL vs PL) | |||||||
| Delegation cascade | 342,300 | 5 | 92,400 | 2.28 | Trunc. PL | 118 | 103 | +4.6 | 0.002 | +2.8 | 0.009 |
| Revision wave | 344,300 | 4 | 134,300 | 2.41 | Trunc. PL | 74 | 61 | +3.8 | 0.005 | +1.7 | 0.037 |
| Contradiction burst | 255,300 | 4 | 56,200 | 2.16 | Trunc. PL | 83 | 73 | +4.2 | 0.004 | +0.9 | 0.020 |
| Merge fan-in | 278,500 | 3 | 39,000 | 2.71 | Trunc. PL | 33 | 27 | +3.9 | 0.006 | +3.3 | 0.001 |
| Total Cognitive Effort (TCE) | 411,300 | 8 | 123,400 | 2.22 | Trunc. PL | 1320 | 1203 | +5.1 | 0.001 | +2.8 | 0.012 |
| Chain | Star | Hierarchical | Mesh | ||||||||||||||
| Observable | Task | LR T/LN | LR T/PL | LR T/LN | LR T/PL | LR T/LN | LR T/PL | LR T/LN | LR T/PL | ||||||||
| Delegation | Coding | 2.46 | 22 | 2.30 | 29 | 2.36 | 26 | 2.16 | 37 | ||||||||
| QA | 2.64 | 15 | 2.48 | 19 | 2.54 | 17 | 2.34 | 24 | |||||||||
| Planning | 2.24 | 36 | 2.08 | 48 | 2.14 | 43 | 1.94 | 61 | |||||||||
| Reasoning | 2.34 | 29 | 2.18 | 39 | 2.24 | 35 | 2.04 | 49 | |||||||||
| Merge Fan-In | Coding | 2.89 | 6 | 2.73 | 8 | 2.79 | 7 | 2.59 | 10 | ||||||||
Appendix figures & tables32 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Meaning |
| Random variable representing an event-size observable | |
| Realized value of | |
| Complementary cumulative distribution function (CCDF) of | |
| Tail exponent of the power-law / truncated power-law model | |
| MLE estimate of | |
| Lower cutoff above which tail fitting is performed |
| Symbol | Meaning |
| Total Cognitive Effort: total number of downstream events from root claim | |
| Top- contribution share within cascade | |
| Top- % effort share; denominator = active agents only | |
| Top- % effort share; denominator = all agents | |
| Excess share above egalitarian baseline | |
| Cumulative concentration curve (Lorenz-style) |
| Symbol | Meaning |
| Maximum cascade size in a system of agents | |
| Expected maximum event size (averaged over runs) | |
| Empirically estimated extreme-value scaling exponent | |
| Theoretical EVT prediction for scaling exponent |
| Symbol | Meaning |
| Routing ratio: relative likelihood a claim with activity is selected | |
| Reinforcement strength in the routing rule (Eq. 6 ) | |
| Empirical condition-level attachment slope | |
| Event-specific attachment slope | |
| Contradiction scaling exponent used in DTI pressure model | |
| Continuation probability per event type |
| Observable | CI | KS | ||
| Delegation | 2.28 | [2.24, 2.32] | 0.27 | 0.042 |
| Revision | 2.41 | [2.36, 2.46] | 0.31 | 0.047 |
| Contradiction | 2.16 | [2.11, 2.21] | 0.22 | 0.039 |
| Merge | 2.71 | [2.63, 2.79] | 0.14 | 0.051 |
| TCE | 2.22 | [2.18, 2.26] | 0.30 | 0.035 |
| Top-1 | Top-10% | Gini | ||
| 8 | 0.04 | 0.17 | 0.20 | 0.88 |
| 32 | 0.07 | 0.21 | 0.25 | 0.81 |
| 128 | 0.08 | 0.23 | 0.31 | 0.73 |
| 512 | 0.11 | 0.29 | 0.39 | 0.64 |
| Metric | Mean | Std (across seeds) |
| Gini | 0.37 | 0.018 |
| Top-10% share | 0.29 | 0.017 |
| 0.64 | 0.015 |
| Percentile | Delegation | Contradiction | Merge | Merge ratio |
| Median | 0.30 | 0.21 | 0.19 | 0.37 |
| 90th | 0.36 | 0.26 | 0.15 | 0.24 |
| 99th | 0.41 | 0.31 | 0.11 | 0.15 |
| Top 1% | 0.45 | 0.34 | 0.08 | 0.10 |
| Benchmark | Seeds | Expanded tasks | Avg. dependencies |
| GAIA | 30 | 150 | 2.1 |
| SWE-bench | 30 | 150 | 2.4 |
| REALM | 11 | 55 | 2.0 |
| MultiAgentBench | 30 | 150 | 2.3 |
| Claim Type | Description |
| Proposed Claim | An initial statement or solution generated by an agent. |
| Revised Claim | A modification of a prior claim that refines or corrects it. |
| Contradictory Claim | A claim that challenges or disputes an existing claim. |
| Merged Claim | A claim produced by combining multiple parent claims. |
| Event Type | Operation on Claims | Resulting Structure |
| revise_claim | single parent child | chain |
| contradict_claim | parent multiple children | branching |
| merge_claims | multiple parents child | multi-parent (DAG) |
| delegate_subtask | creates new subtask context | hierarchical tree |
| Field | Description |
| run_id | Identifier for the experiment run |
| step_id | Temporal ordering of events |
| agent_id | Acting agent |
| event_type | Type of coordination event |
| target_claim_id | Referenced claim (if applicable) |
| target_subtask_id | Referenced subtask (if applicable) |
| Field | Description |
| claim_id | Unique identifier for each claim |
| parent_claim_ids | Parent claims defining DAG edges |
| root_claim_id | Root ancestor of the claim |
| claim_depth | Depth within the claim DAG |
| claim_status | Proposed, revised, contradictory, or merged |
| Field | Description |
| subtask_id | Unique identifier for each subtask |
| parent_subtask_id | Parent subtask in hierarchy |
| subtask_depth | Depth in subtask tree |
| assigned_agent | Responsible agent |
| subtask_status | Active or completed |
| Field | Description |
| revision_chain_id | Groups claims in a revision sequence |
| contradiction_group_id | Groups claims targeting the same parent claim |
| merge_id | Identifier for merge operations |
| merge_parent_ids | Parent claims involved in merge |
| Observable | Trigger Condition | Structure | Output |
| Delegation Cascade | Subtree rooted at a delegate_subtask event | Subtask tree | Node count |
| Revision Wave | Maximal chain of claims with identical revision_chain_id | Claim DAG | Length |
| Contradiction Burst | Claims referencing the same parent claim within a temporal window | Claim DAG + timestamps | Count |
| Merge Fan-in | Number of parent_claim_ids in a merge_claims event | Claim DAG | In-degree |
| Total Cognitive Effort (TCE) | Reachable subgraph from root_claim_id | Cascade | Size |
| Tail structure | LR tests | Pref. Reinf. | Concentration | Outcome | |||||
| Model | Active | Task Succ. | |||||||
| GPT-4o-mini | 2.22 | 57 | 1320 | +5.2 | +2.8 | 0.16 | 25% | 81% | 0.48 |
| Qwen 2.5 72B | 2.27 | 44 | 1035 | +5.0 | +2.7 | 0.15 | 23% | 79% | 0.43 |
| Llama 3.1 70B | 2.34 | 30 | 1012 | +4.8 | +2.5 | 0.13 | 19% | 78% | 0.41 |
| Qwen 2.5 7B | 2.74 | 9 | 440 | +3.5 | +1.7 | 0.07 | 14% | 72% | 0.27 |
| Tail structure | LR tests | Concentration | Outcome | ||||
| Topology | Model | Task succ. | |||||
| Chain | GPT-4o-mini | 2.49 | 23 | +4.6 | +2.6 | 17% | 0.43 |
| Qwen 2.5 72B | 2.52 | 21 | +4.5 | +2.5 | 16% | 0.40 | |
| Llama 3.1 70B | 2.61 | 18 | +4.2 | +2.3 | 14% | 0.36 | |
| Qwen 2.5 7B | 2.88 | 9 | +3.0 | +1.5 | 11% | 0.19 | |
| Star | GPT-4o-mini | 2.21 | 44 | +5.2 | +2.8 | 32% | 0.47 |
| Tail structure | LR tests | Concentration | Outcome | ||||
| Task type | Model | Task succ. | |||||
| Planning | GPT-4o-mini | 2.11 | 54 | +5.2 | +2.2 | 30% | 0.45 |
| Qwen 2.5 72B | 2.14 | 50 | +5.1 | +2.1 | 27% | 0.41 | |
| Llama 3.1 70B | 2.23 | 44 | +4.8 | +1.9 | 22% | 0.40 | |
| Qwen 2.5 7B | 2.53 | 14 | +3.6 | +1.1 | 16% | 0.23 | |
| Reasoning | GPT-4o-mini | 2.20 | 45 | +5.2 | +2.7 | 23% | 0.56 |
| Component | Configuration |
| Benchmarks | GAIA, SWE-bench Verified, REALM-Bench, MultiAgentBench |
| Task types | QA, reasoning, coding, planning |
| Total tasks | 400 (stratified across benchmarks and difficulty levels) |
| Agent counts ( ) | |
| Topologies | Chain, Star, Tree, Hierarchical, Fully Connected, Sparse Mesh, Dynamic Reputation |
| Agent model | Shared LLM (GPT-4o-mini) |
| Observable | Samples | Mean/run |
| Delegation cascades | ||
| Revision waves | ||
| Contradiction bursts | ||
| Merge events | ||
| TCE (root cascades) | ||
| Total |
| Component | Configuration |
| Orchestration | LangGraph (uniform routing, state, and execution) |
| Base prompt | Task, neighbors, structured history |
| Topology addendum | Topology-specific routing behavior (chain, star, tree, hierarchical, mesh, reputation) |
| Task addendum | Benchmark-specific instructions (QA, coding, planning, reasoning) |
| Tool access | Restricted to benchmark-native tools |
| Context budget | 4000-token window |
| Benchmark | Task type | Approx. tasks | Difficulty |
| GAIA | QA / multimodal reasoning | 150 | Medium–Hard |
| SWE-bench Verified | Code debugging / patching | 235 | Hard |
| REALM-Bench | Planning / constraint reasoning | 14 | Hard |
| MultiAgentBench | Coordination / interaction tasks | 6 scenarios | Variable |