Organizations: Tianjin University, Tianjin, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · Peking University, Beijing, China · University of Bristol, Bristol, United Kingdom
Social norms are stable behavioral patterns that emerge endogenously within economic systems through repeated interactions among agents. In online market economies, such norms -- like fair exposure, sustained participation, and balanced reinvestment -- are critical for long-term stability. We aim to understand the causal mechanisms driving these emergent norms and to design principled interventions that can steer them toward desired outcomes. This is challenging because norms arise from countless micro-level interactions that aggregate into macro-level regularities, making causal attribution and policy transferability difficult. To address this, we propose Invariant Causal Routing (ICR), a causal governance framework that identifies policy-norm relations stable across heterogeneous environments. ICR integrates counterfactual reasoning with invariant causal discovery to separate genuine causal effects from spurious correlations and to construct interpretable, auditable policy rules that remain effective under distribution shift. In heterogeneous agent simulations calibrated with real data, ICR yields more stable norms, smaller generalization gaps, and more concise rules than correlation or coverage baselines, demonstrating that causal invariance offers a principled and interpretable foundation for governance.
Figures & tables
Figure 1. Social norms in onlineeconomies.
Figure 2. Three-stage framework for discovering causal strategies in social norm formation. Stage I tests causal effects by identifying implicit contracts (θ,g∣ψ) where policy θ enables group g to reach the norm under context ψ . Stage II learns a compact rule router S⋆ selecting effective strategies for robust norm attainment. Stage III explains success by attributing norms to key factors where user responses differ from the baseline θ0 .
Figure 3. Last-50-year trajectories of ϕ1 (ST) and ϕ2 (RI) with norm bands (per objective × group). Shaded regions of the same color indicate the band within which individuals of the corresponding group are expected to remain under the associated social norm. When all trajectories lie within their respective same-colored shaded regions, the social norm is fully attained.
Norm
Baseline
Current
Group
PNS
RI-1
NI
FAI
ALL
0.966 [0.904, 0.993]
RI-1
GMV
FAI
ALL
0.981 [0.899, 1.000]
RI-1
BAL
FAI
ALL
0.962 [0.893, 0.992]
ST-1
BAL
GMV
ALL
0.857 [0.722, 0.933]
ST-1
FAI
GMV
ALL
0.887 [0.774, 0.947]
ST-1
UW
GMV
ALL
0.905 [0.779, 0.962]
Table 1. Representative PNS-significant causal routes selected by Stage I and Stage II. Entries report PNS with 95% binomial confidence intervals as value [lower, upper] .
Method
PNS train↑
Cov train↑
PNS test↑
Cov test↑
Rules ↓
Rules norm↓
Gap ↓
Perf. ↑
PNS+Greedy
0.989
0.990
0.953
0.966
24
0.300
0.036
0.862
PNS+Greedy (pruned)
0.972
0.981
0.931
0.938
12
0.150
0.041
0.883
Corr+Greedy (Pearson)
0.805
0.958
0.741
0.931
46
0.575
0.064
0.600
Corr+Greedy (Pearson, pruned)
0.742
0.840
0.677
0.796
18
0.225
0.065
0.627
Coverage-Driven
0.622
0.944
0.565
0.915
48
0.600
0.057
0.449
Coverage+Corr Hybrid
0.416
0.564
0.384
0.550
80
1.000
0.032
0.114
Table 2. Ablation results on disjoint train/test seeds (Perf recomputed with K=80 ). Higher ↑ is better; lower ↓ is better.
Figure 4. Key factors attribution for invariant causal routes.
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
IC
CRRA
IFE
ep
eq
ρe
σe
supere
IC1
1.0
2.0
2.2×10−6
0.990
0.982
0.20
504.3
IC2
1.5
1.8
5.0×10−6
0.985
0.975
0.18
400
IC3
0.7
2.5
8.0×10−6
0.985
0.990
0.15
350
IC4
1.2
2.2
1.0×10−5
0.920
0.950
0.22
450
IC5
2.0
1.5
3.0×10−6
0.995
0.990
0.25
600
Appendix
Table 3. Initial-condition (IC) configurations used in all experiments.
In this paper, we explore using generative agent-based models for a classical ABM application: testing how individual-level behavioral rules produce collective phenomena. We introduce RePair, a method that calibrates simulation worlds, operationalizes candidate mechanisms as natural-language rules, estimates their effects through matched interventions, and examines behavioral traces. We assess the method by testing it in four simulation worlds grounded in established social-science models and empirical studies. Our results reveal that (1) natural-language rules can produce measurable collective effects; (2) rule comparisons can converge as configurations accumulate; and (3) behavioral traces connect collective effects to agents' actions and interactions, helping researchers evaluate the proposed causal process. Together, these findings show the feasibility of using generative agent-based models to explore causal mechanisms and provide practical guidance for producing reliable, interpretable explanations.
Xuan Liu, Haoyang Shang, Tanya Bhat +1
University of California, San Diego · University of British Columbia
Online platforms increasingly rely on opinion aggregation to allocate real-world attention and resources, yet common signals such as engagement votes or capital-weighted commitments are easy to amplify and often track visibility rather than reliability. This makes collective judgments brittle under weak truth signals, noisy or delayed feedback, early popularity surges, and strategic manipulation. We propose Credibility Governance (CG), a mechanism that reallocates influence by learning which agents and viewpoints consistently track evolving public evidence. CG maintains dynamic credibility scores for both agents and opinions, updates opinion influence via credibility-weighted endorsements, and updates agent credibility based on the long-run performance of the opinions they support, rewarding early and persistent alignment with emerging evidence while filtering short-lived noise. We evaluate CG in POLIS, a socio-physical simulation environment that models coupled belief dynamics and downstream feedback under uncertainty. Across settings with initial majority misalignment, observation noise and contamination, and misinformation shocks, CG outperforms vote-based, stake-weighted, and no-governance baselines, yielding faster recovery to the true state, reduced lock-in and path dependence, and improved robustness under adversarial pressure. Our implementation and experimental scripts are publicly available at https://github.com/Wanying-He/Credibility_Governance.
Wanying He, Yanxi Lin, Ziheng Zhou +5
School of Artificial Intelligence, Wuhan University; BIGAI Wuhan, China · Tsinghua University Beijing, China · University of California, Los Angeles Los Angeles, US +2
By specifying behaviour across multiple agents, social norms are a coordination approach to resolving social dilemmas. Decentralized and wide adoption can be achieved by norms whose prescription involves interpreting stochastic signals in the environment. Such signals must have enough correlation to orchestrate mutually beneficial coordination and enough disincentivizing uncertainty about the benefits of exploiting that coordination. Evolutionary game theory of matrix games has been used to describe how, by rational agents comparing and adopting norms, a norm can evolve to become dominant in a population. Morsky & Akçay (2019) classify norms according to a set of rationality criteria. Joint player strategies that adopt norms that are consistent with optimal single-player strategies with respect to expected reward naturally satisfy a correlated, rather than Nash game theoretic equilibrium condition. Here, we present a version of this theory that clarifies the basic ingredients. We formulate it in the more general Markov game setting more commonly used in reinforcement learning theory. We illustrate the theory by mapping norms over the signal and reward space, while also giving a detailed exposition of the underlying mechanics of the approach. Finally, we give a general solution and analysis of replicator dynamics, which Morsky & Akçay (2019) propose as a means by which these norms could emerge.