Computational Multi-Agents Society Experiments: Social Modeling Framework Based on Generative Agents
Organizations: William & Mary, Williamsburg, VA, USA · Stanford University, Stanford, CA, USA
Abstract
Computational social science has developed descriptive, interpretative, and predictive modeling, but comprehensive modeling combining in-world human intervention with outcome forecasting remains underexplored. Generative agent-based platforms scale populations or reproduce complex scenarios, but researchers typically act through setup, external controls, or post-hoc analysis rather than in-world roles. We introduce Computational Multi-Agent Society Experiments (CMASE), a generative agent-based framework for in-world researcher participation and traceable interventions at runtime. Treating simulation as a simulated ethnographic field, CMASE supports (1) real-time human-computer interaction to study intervention processes; (2) controlled experiments with ethnography-inspired observation, interviewing, and interpretation; and (3) forward exploration of intervention trajectories and downstream responses. CMASE combines LLM-driven perception, memory, and emotion; a composable environment built from texture and area maps; and researcher roles spanning observation, interviewing, participation, and intervention, so that interventions enter as social events rather than exogenous parameters. We replicate two published field studies from different disciplines: urban greenery and social fragmentation, and cooperation in a public goods game, using two substantially different language models. CMASE reproduces reported statistical patterns and provides process-level records for mechanism-oriented interpretation. A controlled comparison shows that embedded social interventions leave observable, auditable processes that parametric manipulation does not. These findings highlight CMASE's methodological value for studying interventions in small- and medium-scale social settings and its interdisciplinary potential. The official code is available at: https://github.com/armihia/CMASE.
Figures & tables
| Framework | Runtime human embedding | Intervention as social variable | Process tracing of interventions | Interpretive output |
| AgentSociety ( Piao et al., 2025 ) | (✓) (external controls) | ✗ | (✓) (logged outcomes) | (✓) (interviews, surveys) |
| OASIS ( Yang et al., 2024 ) | ✗ | ✗ | (✓) | ✗ |
| GenSim ( Tang et al., 2024 ) | (✓) (global intervention) | ✗ | (✓) | (✓) (interviews) |
| Socioverse ( Zhang et al., 2025 ) | (✓) (interview module) | ✗ | (✓) | (✓) (interviews) |
| Collaborative Gym ( Shao et al., 2024 ) | ✓ (task-level) | ✗ | ✗ | ✗ |
| HABITAT 3.0 ( Puig et al., 2023 ) | ✓ (embodied task) | ✗ | ✗ | ✗ |
| Sec. | Evaluation | CMASE capability | Comparison or RQ | Principal measures and key outcomes |
| Study 1: Green Space and Social Fragmentation | ||||
| 4.3 | Quantitative reconstruction | Pattern reproduction | Does CMASE reproduce the reported vegetation effect? | Indicator Low High Distrust ∗ 4.60 3.60 Exploitation ∗ 4.30 3.40 Indifference 3.70 2.70 |
| 4.4 | Embedded inquiry | In-world inquiry | Can embedded inquiry reveal process-level patterns behind the aggregate result? | Indicator Observed pattern Indoor-agent coping Occupation-dependent coping Green-space use Lakeside clustering |
| 4.5 | Agent and record evaluation | Fidelity and interpretability | Are assigned personas preserved and do the records support interpretation? | Indicator Mean score Persona fidelity 4.23 Interpretive affordances 4.25 |
| 4.6 | Runtime usability | Real-time participation | How does runtime scale, and what is the real-time participation bound? | Indicator Outcome Step time (1–10 agents) 23 s Real-time participation bound agents |
| Study 2: Public-Goods Cooperation and Intervention | ||||
| CMASE | Human NDVI | Human EVI | ||||
| Dimension | Low Veg | High Veg | Low Veg | High Veg | Low Veg | High Veg |
| Distrust | 4.0 | 1.6 | 4.5 | 1.1 | ||
| Exploitation | 5.0 | 1.4 | 4.5 | 1.6 | ||
| Indifference | 5.1 | 1.3 | 5.5 | 0.9 | ||
| Persona Cluster | Consistency | Responsiveness | Emotional Alignment | Overall |
| Creative and Design | 4.00 | 3.33 | 4.67 | 4.00 |
| Analytical and Academic | 4.33 | 3.33 | 4.33 | 4.00 |
| Technical and Strategic | 4.00 | 4.00 | 5.00 | 4.33 |
| Public and Healthcare | 5.00 | 4.50 | 5.00 | 4.83 |
| Average | 4.30 | 3.70 | 4.70 | 4.23 |
| Persona Cluster | Thick Description | Traceability | Interaction Depth | Mechanistic Insight | Overall |
| Creative and Design | 4.33 | 4.00 | 3.33 | 3.67 | 3.83 |
| Analytical and Academic | 5.00 | 4.00 | 4.33 | 4.00 | 4.33 |
| Technical and Strategic | 4.00 | 4.00 | 4.50 | 4.50 | 4.25 |
| Public and Healthcare | 5.00 | 5.00 | 4.50 | 4.50 | 4.75 |
| Average | 4.60 | 4.20 | 4.10 | 4.10 | 4.25 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Parameter | Value |
| Number of agents | 10 |
| Simulation length | 50 time steps |
| Base model | GPT-4o (2024-12-01-preview) |
| Vegetation conditions | high / low (texture and perceptual layers) |
| Isolation mechanism | standing wall barriers with boundary guard |
| Gender distribution | 50% male, 50% female |
| Name | Occupation | Age | Long-term goal (abbreviated) |
| Joon-ho Kim | Software Engineer | 31 | Face nighttime panic alone and curb overreliance on community surveillance tools. |
| Min-jae Lee | Cardiologist | 42 | Accept his insomnia and helplessness, ease resentment toward the medical system. |
| Hyun-woo Park | University Professor | 50 | Stop letting formulas conceal inner emptiness; come to terms with social division. |
| Seok-jin Choi | Film Director | 38 | Put down the camera and allow himself to rest, not rely on the lens for connection. |
| Dong-hyun Jung | Entrepreneur | 29 | Let go of the startup-zealot persona during isolation. |
| Ji-eun Kim | Fashion Designer | 33 | Rediscover the purpose of her art beyond designing fashionable masks. |
Computational Social Science
Computational social science uses data and computational models to study social behavior, institutions, communication, and collective outcomes.
See all 165 papers