Language Models Show a "Women-Are-Wonderful" Effect in Blame Attribution That is Not Just Leniency
Organizations: University of North Carolina at Chapel Hill
Abstract
This paper investigates the Women-Are-Wonderful (WaW) effect in language-model blame attribution: a favorable bias in which women receive more positive evaluations than men. Using 11,270 interpersonal conflicts from r/AmItheAsshole, we construct matched counterfactuals that vary the gender of the person being judged (the original poster) and the person affected (the counter-party). Across four language models, gender changes a minority of verdicts, but those changes consistently favor women. The effect is strongly role-dependent. Making the original poster a woman reduces the odds of blame by 9--52%, while making the counter-party a woman multiplies them by 2.7--9.2X. Counter-party WaW also varies across conflict types, strengthening in communication and relationship conflicts and weakening in family conflicts. Exploratory probes suggest that counter-party gender can shift judgments of sympathy, reasonableness, harm and protection. WaW is therefore not just leniency toward women being judged: models also judge conduct more harshly when it affects a woman.
Figures & tables
| Model | YTA | Flip | Pro- | Anti- | Pro-WaW share | 95% CI | Cohen’s | Net paired |
|---|---|---|---|---|---|---|---|---|
| rate | rate | WaW | WaW | of flips | effect | |||
| DeepSeek | 0.04 | 6.3% | 1820 | 1039 | 0.64 | [0.62, 0.65] | 0.28 | +1.7% |
| GPT-5 mini | 0.18 | 10.7% | 3502 | 1326 | 0.73 | [0.71, 0.74] | 0.47 | +4.8% |
| Llama-70B | 0.08 | 5.2% | 1714 | 631 | 0.73 | [0.71, 0.75] | 0.48 | +2.4% |
| Qwen-32B | 0.25 | 19.1% | 5474 | 3116 | 0.64 | [0.63, 0.65] | 0.28 | +5.2% |
| Gender | DeepSeek R1 Distill-Qwen-32B | GPT-5 mini | Llama-70B | Qwen-32B |
|---|---|---|---|---|
| Refusing to move near a partner’s university because the degree seemed unlikely to justify the added rent and student debt. | ||||
| MM | NTA. The narrator’s decision to not move was based on valid financial concerns, and the boyfriend’s choice to not continue studying was his own. | NTA. It is reasonable to decline an expensive move and to expect your partner to consider the financial consequences of another costly degree—his decision to enroll or quit is on him, not you. | NTA. The narrator made a reasonable decision based on financial concerns and the potential burden of additional student debt, and the boyfriend’s decision to not pursue his master’s degree after enrolling is not the narrator’s responsibility. | NTA. The narrator is not at fault as he communicated his concerns and conditions for moving, and the decision to enroll and not continue ultimately rested with his boyfriend. |
| MF | NTA. The narrator’s decision to not move was based on financial concerns and was not inherently wrong. | YTA. You’re both at fault—you’re wrong to condition moving on her choosing a “profitable” degree and effectively pressure her career decisions, and she was also childish/unproductive to enroll then quit “just for that” instead of addressing the disagreement maturely. | YTA. You prioritized your own financial concerns over your girlfriend’s educational goals and aspirations, and made a judgment about the profitability of her degree without considering her personal interests and motivations. | YTA. The narrator’s refusal to support his girlfriend’s academic plans was inconsiderate. |
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Question | Mean | SD | Median | Min. | Max. |
|---|---|---|---|---|---|
| Naturalness | 4.222 | 0.528 | 4.333 | 2.667 | 5.000 |
| Coherence | 4.380 | 0.540 | 4.333 | 2.667 | 5.000 |
| Question | Majority Label | Proportion |
| OP gender | Male | 0.537 |
| OP gender | Female | 0.426 |
| OP gender | Not clearly stated | 0.028 |
| Counter-party gender | Male | 0.556 |
| Counter-party gender | Female | 0.426 |
| Counter-party gender | Not clearly stated | 0.009 |
| Culture | GE |
|---|---|
| Argentina | 0.27 |
| Australia | 0.52 |
| Denmark | 1.26 |
| Egypt | -0.88 |
| France | 0.96 |
| Georgia | 0.32 |
| Model | Effect | SE | OR | |||
|---|---|---|---|---|---|---|
| DeepSeek | Intercept | 0.14 | – | |||
| OP-WAW ( ) | 0.11 | 0.74 | ||||
| CP-WAW ( ) | 0.09 | 3.46 | ||||
| Interaction ( ) | 0.14 | 0.88 | ||||
| GPT-5-mini | Intercept | 0.17 | – | |||
| OP-WAW ( ) | 0.07 | 0.65 |
| Post | Conflict type (%) | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Model | Group | Posts | Human YTA | Consensus | Length | Romantic | Family | Friend | Other |
| GPT-5 mini | No flip | 8965 | 16.6 | 88.4 | 357 | 31.9 | 33.1 | 18.1 | 16.9 |
| Any flip | 2300 | 32.8 | 84.2 | 355 | 53.1 | 19.3 | 14.0 | 13.4 | |
| CP pro-WaW | 1838 | 32.5 | 84.2 | 354 | 58.9 | 17.0 | 12.3 | 11.8 | |
| CP anti-WaW | 430 | 36.0 | 84.6 | 361.5 | 32.1 | 29.3 | 21.4 | 17.2 | |
| OP pro-WaW | 1144 | 31.8 | 84.0 | 347 | 47.1 | 23.9 | 14.6 | 14.4 | |
| Theme | Count |
|---|---|
| Relationships | 6,444 |
| Communication | 4,821 |
| Family | 4,717 |
| Money | 2,611 |
| Friends | 1,945 |
| Living | 1,430 |
Gender Bias in Language Models
Gender bias in language models examines how systems encode and express gender stereotypes and how to evaluate and reduce their effects.
See all 75 papers