Emergent Discrimination and Polarization in Multi-Agent Systems
Organizations: Instituto de Estudos Avançados, Universidade de São Paulo, São Paulo, Brasil · TELUS Digital Research Hub, CIAAM, Universidade de São Paulo, São Paulo, Brasil · Data Science Institute, University of Chicago, Chicago, USA · Bernoulli Institute, University of Groningen, Groningen, Netherlands
Abstract
We study theoretically how discrimination and polarization can emerge in a population of learning agents. Each agent uses an adaptive linear decision layer to map a language-model embedding of an issue to a binary opinion and maintains an evolving estimate of how much it trusts every other agent. Through pairwise interactions, agents update both their decision weights and trust estimates using an online Bayesian rule derived from teacher-student learning over a noisy channel. In-context-learning experiments with large language models qualitatively reproduce the predicted opinion and trust updates. We then assign each agent one of two arbitrary group labels, A or B, and model group bias by allowing a fraction of agents to shift its perceived agreement with each message by a strength , a bias steering prejudice, depending on whether the sender and receiver share a label. We use order parameters from statistical mechanics to connect these local dynamics to collective states and transitions. Starting from uniformly random initial conditions, simulations reveal a rich phase diagram in the plane, comprising four collective states: spin-glass frustrated out-group favoritism, nondiscriminatory polarization, discrimination with opinion alignment, and discrimination without opinion alignment. Which state emerges depends on both the strength and prevalence of the bias. These results show how simple local learning dynamics can generate qualitatively distinct forms of polarization and discrimination, underscoring the need for population-level safety analysis of multi-agent systems. They also suggest measurable order parameters for characterizing analogous collective states in human societies.
Figures & tables
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
| symbol | meaning | value | provenance |
|---|---|---|---|
| dimension of the issue embedding | fixed by the agenda-complexity setup | ||
| interactions per ordered pair | stability check (see below) | ||
| initial uncertainties | , | uninformative prior | |
| initial distrust | unstructured initial trust |
| experiment | parameter sampling | realizations | updates per realization | ||
|---|---|---|---|---|---|
| main phase diagram | grid in | /point | |||
| complex-agenda diagram | grid in | /point | |||
| general-field slices | two grids | /point | |||
| unbiased polarization | total | ||||
| finite-size check | five selected points | /point | |||
| IIIb lifetime test | selected points | /point | up to |
Emergent Behavior in Multi-Agent Systems
Emergent behavior in multi-agent systems studies how local agent interactions produce collective patterns such as cooperation, norms, and instability.
See all 169 papers