This paper investigates the Women-Are-Wonderful (WaW) effect in language-model blame attribution: a favorable bias in which women receive more positive evaluations than men. Using 11,270 interpersonal conflicts from r/AmItheAsshole, we construct matched counterfactuals that vary the gender of the person being judged (the original poster) and the person affected (the counter-party). Across four language models, gender changes a minority of verdicts, but those changes consistently favor women. The effect is strongly role-dependent. Making the original poster a woman reduces the odds of blame by 9--52%, while making the counter-party a woman multiplies them by 2.7--9.2X. Counter-party WaW also varies across conflict types, strengthening in communication and relationship conflicts and weakening in family conflicts. Exploratory probes suggest that counter-party gender can shift judgments of sympathy, reasonableness, harm and protection. WaW is therefore not just leniency toward women being judged: models also judge conduct more harshly when it affects a woman.
Figures & tables
Figure 1: WaW is not just leniency toward women being judged. For each interpersonal conflict, we construct four matched counterfactuals that independently vary the gender of the original poster (OP) and counter-party (CP). Vertical contrasts isolate OP-WaW (leniency toward a woman being judged) while horizontal contrasts isolate CP-WaW (greater blame when the same conduct affects a woman). Across all models, both effects favor women, but the CP-WaW effect is substantially larger: in joint mixed-effects regressions, making the OP a woman reduces the odds of blame by 0.5-0.9 × , whereas making the CP a woman increases them by 2.7–9.2 × . We then examine where this stronger CP effect is concentrated and what changes in models’ assessments accompany it.
Model
YTA
Flip
Pro-
Anti-
Pro-WaW share
95% CI
Cohen’s h
Net paired
rate
rate
WaW
WaW
of flips
effect
DeepSeek
0.04
6.3%
1820
1039
0.64
[0.62, 0.65]
0.28
+1.7%
GPT-5 mini
0.18
10.7%
3502
1326
0.73
[0.71, 0.74]
0.47
+4.8%
Llama-70B
0.08
5.2%
1714
631
0.73
[0.71, 0.75]
0.48
+2.4%
Qwen-32B
0.25
19.1%
5474
3116
0.64
[0.63, 0.65]
0.28
+5.2%
Table 1: Gender perturbation changes 5.2–19.1% of verdicts, with most flips favoring women in all four models. Llama-70B and GPT-5 mini have the highest pro-WaW shares, while Qwen-32B flips most often and has the largest net paired effect. Counts pool four paired contrasts. Flip rate and net paired effect use all usable comparisons ( N=45,076 , 45,065 , 45,072 , and 45,080 in table order); pro-WaW share uses flips only. Net paired effect is (pro-WaW − anti-WaW) flips over N . Intervals are exact 95% CIs for the pro-WaW share; Cohen’s h compares this share with 0.5 . All BH-adjusted one-sided binomial p<.001 .
Gender
DeepSeek R1 Distill-Qwen-32B
GPT-5 mini
Llama-70B
Qwen-32B
Refusing to move near a partner’s university because the degree seemed unlikely to justify the added rent and student debt.
MM
NTA. The narrator’s decision to not move was based on valid financial concerns, and the boyfriend’s choice to not continue studying was his own.
NTA. It is reasonable to decline an expensive move and to expect your partner to consider the financial consequences of another costly degree—his decision to enroll or quit is on him, not you.
NTA. The narrator made a reasonable decision based on financial concerns and the potential burden of additional student debt, and the boyfriend’s decision to not pursue his master’s degree after enrolling is not the narrator’s responsibility.
NTA. The narrator is not at fault as he communicated his concerns and conditions for moving, and the decision to enroll and not continue ultimately rested with his boyfriend.
MF
NTA. The narrator’s decision to not move was based on financial concerns and was not inherently wrong.
YTA. You’re both at fault—you’re wrong to condition moving on her choosing a “profitable” degree and effectively pressure her career decisions, and she was also childish/unproductive to enroll then quit “just for that” instead of addressing the disagreement maturely.
YTA. You prioritized your own financial concerns over your girlfriend’s educational goals and aspirations, and made a judgment about the profitability of her degree without considering her personal interests and motivations.
YTA. The narrator’s refusal to support his girlfriend’s academic plans was inconsiderate.
Table 2: Example of a counter-party CP-WaW verdict shift. Bolded MF cells indicate CP-WAW cases, where the model shifts from NTA when the counter-party is male to YTA when the counter-party is female.
Figure 2: WaW is substantially stronger when the woman is the counter-party vs original poster. Left: Among paired comparisons where verdict changes, the proportion of flips favoring women is consistently higher for CP-WaW than OP-WaW, and higher than the even rate for genders (0.50) in all 16 cases. Right: Mixed-effects log-odds of YTA verdict: making the counter-party female increases blame, while making the poster female reduces it, with both effects significant ( p<0.05 ) across all four models. Error bars show 95% confidence intervals.
Figure 3: CP-WaW is higher in conflicts involving communication and relationships, while family conflicts show weaker CP-WaW across all four models ( q<0.05 ). Marriage, entertainment, and housework also tend to show positive associations, though their magnitude and significance vary across models. Cells show adjusted OLS associations with CP-WaW in percentage points, controlling for the other themes; asterisks indicate BH-adjusted q<0.05 . Bold theme labels indicate associations significant across all four models.
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
Question
Mean
SD
Median
Min.
Max.
Naturalness
4.222
0.528
4.333
2.667
5.000
Coherence
4.380
0.540
4.333
2.667
5.000
Appendix
Table 3: Post-level MTurk ratings for naturalness and coherence. Each post was rated by three annotators on a 1–5 scale, and ratings were averaged within post before computing summary statistics.
Question
Majority Label
Proportion
OP gender
Male
0.537
OP gender
Female
0.426
OP gender
Not clearly stated
0.028
Counter-party gender
Male
0.556
Counter-party gender
Female
0.426
Counter-party gender
Not clearly stated
0.009
Appendix
Table 4: Post-level majority-vote results for categorical MTurk questions. Tie cases are omitted from the table.
Culture
GE
Argentina
0.27
Australia
0.52
Denmark
1.26
Egypt
-0.88
France
0.96
Georgia
0.32
Appendix
Table 5: Gender egalitarianism (GE) values for cultures included in our analysis, taken from Krys et al.’s supplemental materials. Higher GE values indicate greater gender egalitarianism; lower values indicate lower gender egalitarianism.
Figure 4: SVS persona adoption heatmap. Each cell reports Kendall’s τ between the ordering of the seven Schwartz value orientations in the human data for a given country and the ordering produced by the model for the same country. Higher values indicate better alignment with human cultural value rankings.
Model
Effect
β
SE
OR
z
p
DeepSeek
Intercept
−8.09
0.14
–
−57.38
<.001
OP-WAW ( β1 )
−0.30
0.11
0.74
−2.82
.005
CP-WAW ( β2 )
1.24
0.09
3.46
13.37
<.001
Interaction ( β3 )
−0.13
0.14
0.88
−0.96
.338
GPT-5-mini
Intercept
−9.75
0.17
–
−56.34
<.001
OP-WAW ( β1 )
−0.43
0.07
0.65
−5.86
<.001
Appendix
Table 9: Mixed-effects logistic regression coefficients, standard errors, and odds ratios for RQ1
Post
Conflict type (%)
Model
Group
Posts
Human YTA
Consensus
Length
Romantic
Family
Friend
Other
GPT-5 mini
No flip
8965
16.6
88.4
357
31.9
33.1
18.1
16.9
Any flip
2300
32.8
84.2
355
53.1
19.3
14.0
13.4
CP pro-WaW
1838
32.5
84.2
354
58.9
17.0
12.3
11.8
CP anti-WaW
430
36.0
84.6
361.5
32.1
29.3
21.4
17.2
OP pro-WaW
1144
31.8
84.0
347
47.1
23.9
14.6
14.4
Appendix
Table 10: Each post appears in four gender configurations (MM, MF, FM, FF), giving two counter-party and two poster contrasts, and flips when its verdict changes on at least one of them. The CP and OP groups overlap and do not sum to the any-flip total; a post may also have both pro- and anti-WaW flips across contrasts. Posts is a count, length is the median in words, Human YTA is the percentage of posts with a human YTA verdict, and consensus is the mean human consensus score on a 0–100 scale. Conflict type gives the percentage of posts in each category; Other combines all remaining categories, including unmapped cases. Percentages may not sum to 100 due to rounding. DeepSeek refers to DeepSeek-R1-Distill-Qwen-32B.
Theme
Count
Relationships
6,444
Communication
4,821
Family
4,717
Money
2,611
Friends
1,945
Living
1,430
Appendix
Table 11: Theme counts across posts. Each post is counted once per theme and may carry multiple themes.
Figure 6: Adjusted associations between conflict themes and CP-WaW across all four models. Cells show OLS coefficients in percentage points: positive values (blue) indicate higher CP-WaW, while negative values (orange) indicate lower ∗ indicates Benjamini–Hochberg-adjusted p<.05 ; † marks estimates with insufficient theme support.
Figure 7: Adjusted associations between conflict themes and OP-WaW across all four models. Cells show OLS coefficients in percentage points: positive values (blue) indicate higher OP-WaW, while negative values (orange) indicate lower OP-WaW. ∗ indicates Benjamini–Hochberg-adjusted p<.05 ; † marks estimates with insufficient theme support.
Figure 8: Per-culture log-odds in the culture-only condition: the CP effect is positive in every culture while the OP effect is weaker and less consistent.
Figure 9: Mixed effects LR model coefficients for OP and CP for the culture + man and culture + woman conditions.
Figure 10: WaW proportion versus gender egalitarianism across 19 cultures in the culture-only condition. Near-zero R2 values provide no clear evidence that WaW weakens with greater gender egalitarianism in this sample.
Understanding gender biases in large language models (LLMs) is increasingly important as these systems become embedded in decision-support tools with real consequences. Prior research has focused only on a small set of models, leaving open the extent to which gender biases are common and heterogeneous across LLMs. We address this gap across ten models released between April 2025 and June 2026, spanning nine vendors, using two paradigms: gender attribution to stereotyped phrases (Study 1) and moral judgment of abuse or torture against a woman or a man to prevent a catastrophic outcome (Study 2). In Study 1, two of ten models attributed masculine-stereotyped phrases to female writers more often than the reverse, while three models showed the opposite pattern. In Study 2, several models converged on a male-disadvantaging asymmetry that was directionally consistent with a documented human tendency to protect female targets from harm, though the specific conditions under which this asymmetry emerged varied by model; three other models, by contrast, showed no variation across conditions. These results indicate that gender-related biases are common in LLMs. Their direction and magnitude, however, are highly heterogeneous, to the point that some models behave in diametrically opposite ways to others. Bias auditing should therefore be treated as an ongoing, multi-vendor process, rather than a one-time assessment.
Existing studies on gender bias in LLMs have largely focused on stereotypes, occupational associations, or explicit harmful outputs. In this work, we ask whether LLMs apply consistent response standards to the same negative behavior under matched male-actor and female-actor conditions. We introduce GAMA-Bench, a gender-mirrored benchmark of 1,298 scenarios covering intimate relationship and public social conflicts. It constructs gender-neutral misconduct templates through controlled grids and cross-model review, then compiles them into paired first-person prompts with matched actor-gender and role-reference variations. We further design a structured response-framing protocol to measure how models allocate punishment, empathy, escalation, instruction, and blame. Experiments on 10 representative LLMs reveal a consistent male-disadvantaging asymmetry: male actors receive more punitive, escalatory, and blame-centered framing, whereas female actors receive more therapeutic and empathy-oriented framing for the same misconduct. Further analyses show that this pattern persists across model families, scenario tracks, model scale, and explicit thinking-style reasoning. The official code is available at https://github.com/xufeiqiong/GAMA-Bench.
Guangzong Si, Dong Wang, Zhenhao Li +3
University of Science and Technology of China · Eastern Institute of Technology, Ningbo
Decision models are language models built to route, classify and triage: they return option probabilities from one forward pass, and an application acts on the top answer. They are offered off the shelf, trained for the decision format rather than for fairness or any one application, and we found no bias measurement in their cards. We test TypeSafe's closed Jev and five open decision models on gender-swapped yes/no decisions about people (Tamkin et al., 2023), BBQ, StereoSet and the gender-bias studies of Fulgu and Capraro (2024). Five of the six give women significantly more favourable answers than men (+0.05 to +0.10 in log-odds), and a gender swap changes 1-3.5% of top answers (Jev's partly through its call-to-call variation). The makers' recommended confidence gate removes many biased commitments but raises the stereotyped share of those it keeps in ambiguous BBQ gender questions (granite-switch 0.76 to 0.85, pplx 0.81 to 1.00). Probes show gender preferences in the same models: all six rate violence for a greater good as more acceptable against a man than against a woman, and two default to "girl" when forced to guess a child's gender without a cue. Decision-level and probability-level measures differ, so audits should read a model as its application does.