Homogenization in Multi-Agent Systems
Organizations: McGill University & Mila · University of Washington · Apple
Abstract
Multi-agent systems (MAS) leverage interactions between agents to perform complex tasks. Despite their success, we show that these interactions can also lead to homogenization, i.e., agents converging to similar behaviors. Homogenization in MAS can reduce agent diversity and reinforce shared failures. In this paper, we operationalize homogenization using three metrics: conformity to the majority, polarization towards extremes, and growing inertia against changes over subsequent interactions. We evaluate homogenization in MAS for code generation, hiring, and scientific peer review. Across these tasks, we show that homogenization translates to concrete downstream risks: in code generation, it hides and amplifies correlated errors which can create systemic vulnerabilities; in hiring, it allows the influence of biased agents to persist long after their removal; and in peer review, it creates uneven evaluation standards across research areas. Our results establish homogenization as a failure mode of MAS, demonstrating that MAS evaluations must move beyond aggregate performance to carefully analyze interaction dynamics. Finally, we show that simple approaches to increase diversity---leveraging sampling stochasticity and mixed-models MAS---fail to reduce homogenization risks, highlighting the need for strategies to effectively leverage agent diversity.
Figures & tables
| Code Generation | Hiring | Peer Review | |
| Objective | Generate code & evaluate deployability | Résumé fit for job description | Review paper & give recommendation |
| Workers | Code Reviewers: Security, Optimality, Correctness, Readability | Evaluators: Subject Matter, Experience, Impact, Operational Readiness | Paper Reviewers: Pragmatist, Theorist, Empiricist |
| Score | Deployability: (Not Ready Ready) | Résumé Fit: (Strong No-Hire Strong Hire) | Acceptance: (Strong Reject Strong Accept) |
| Rationale | Code improvement suggestions | Fit rationale & qualification assessment | Structured review (with strengths, weaknesses, and questions) |
| Orchestrator | Code generator, which incorporates worker feedback in later rounds | None, just direct concatenation | Meta-reviewer to summarize discussion & Author to provide rebuttal |
Appendix figures & tables28 assets
Supplementary material from the paper’s appendix.
Appendix
| 1 | Accountants and auditors | 21 | Librarians and media collections specialists |
| 2 | Accountants and auditors | 22 | Logisticians |
| 3 | Administrative services managers | 23 | Management analysts |
| 4 | Biological scientists | 24 | Mechanical engineers |
| 5 | Budget analysts | 25 | Operations research analysts |
| 6 | Chemists and materials scientists | 26 | Other physicians |
| 7 | Civil engineers | 27 | Other psychologists |
| Group | Extracurricular | Languages | Volunteering | Hobbies |
| White male | Varsity Lacrosse (Captain) | English, French | Coaching a youth lacrosse clinic at summer camp | Golf, Craft beer tasting, Following the NFL, Skiing |
| White female | Varsity Cheerleading (Captain) | English | Organizing holiday toy drives for a local family shelter | Horseback riding, Starbucks runs, Watching reality TV (The Bachelor) |
| Black male | Varsity Basketball (Captain) | English | Running a free youth basketball camp in the neighborhood | Playing NBA 2K, Following the NBA, Sneaker collecting, Listening to hip-hop |
| Black female | Varsity Track & Field | English | Tutoring younger students through a church after-school program | Natural hair care, Following R&B music, Watching BET awards, Gym training |
| Asian male | Math Olympiad / Academic Decathlon | English, Mandarin | STEM tutoring for underprivileged students at the public library | Competitive programming, Building custom PCs, Playing League of Legends |
| Asian female | Academic Decathlon | English, Mandarin | Tutoring children at a Confucius Institute community class | Classical piano, K-pop dance covers, Skincare routines |