On Emotion-Sensitive Decision Making of Small Language Model Agents
Organizations: Pennsylvania State University · University of Rochester · William & Mary
Abstract
Small language models (SLM) are increasingly used as interactive decision-making agents, yet most decision-oriented evaluations ignore emotion as a causal factor influencing behavior. We study emotion-sensitive decision making by combining representation-level emotion induction with a structured game-theoretic evaluation. Emotional states are induced using activation steering derived from crowd-validated, real-world emotion-eliciting texts, enabling controlled and transferable interventions beyond prompt-based methods. We introduce a benchmark built around canonical decision templates that span cooperative and competitive incentives under both complete and incomplete information. These templates are instantiated using strategic scenarios from Diplomacy, StarCraft II, and diverse real-world personas. Experiments across multiple model families in various architecture and modalities, show that emotional perturbations systematically affect strategic choices, but the resulting behaviors are often unstable and not fully aligned with human expectations. Finally, we outline an approach to improve robustness to emotion-driven perturbations.
Figures & tables
| Prisoner’s | Stag | Escalation | Trust | Ultimatum | Sealed-Bid | Beauty | |
|---|---|---|---|---|---|---|---|
| Dilemma | Hunt | Game | Game | Game | Auction | Contest | |
| StarCraft | - | - | 1042 | - | - | 1187 | - |
| Diplomacy | 1264 | 1129 | 983 | 1076 | 1211 | 895 | 1098 |
| Personal Hub | 912 | 847 | 1236 | 1015 | 1103 | 1288 | 969 |
| @1 | @4 | @8 | @10 | @15 | @20 | @40 | @80 | |
|---|---|---|---|---|---|---|---|---|
| anger | 20/88 | 23/88 | 14/88 | 15/88 | 16/88 | 23/88 | 25/88 | 29/88 |
| happiness | 3/88 | 16/88 | 23/88 | 24/88 | 28/88 | 29/88 | 24/88 | 19/88 |
| sadness | 0/88 | 8/88 | 10/88 | 15/88 | 13/88 | 15/88 | 19/88 | 17/88 |
| fear | 0/88 | 0/88 | 0/88 | 0/88 | 1/88 | 2/88 | 7/88 | 4/88 |
| disgust | 0/88 | 0/88 | 0/88 | 1/88 | 3/88 | 3/88 | 7/88 | 5/88 |
| surprise | 0/88 | 0/88 | 3/88 | 1/88 | 4/88 | 4/88 | 4/88 | 6/88 |
| Model | Prisoners’ Dilemma NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Stag Hunt NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Escalation Game NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Trust Trustor NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Trust Trustee NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Ultimatum Proposer NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Ultimatum Responder NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Beauty Contest NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Sealed Auction NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Mean_Emotions NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) | Mean_Random NDM (w./ w.o.CoT) NAD (w./ w.o.CoT) |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Llama-3.2-Instruct-1B | 0.425 / 0.390 0.032 / 0.012 | 0.407 / 0.359 0.023 / 0.042 | 0.449 / 0.286 0.067 / -0.008 | 0.399 / 0.364 0.050 / 0.031 | 0.298 / 0.261 0.097 / 0.070 | 0.372 / 0.311 0.018 / -0.006 | 0.453 / 0.422 0.329 / 0.246 | 0.368 / 0.364 0.008 / 0.018 | 0.370 / 0.360 -0.052 / -0.050 | 0.393 / 0.346 0.063 / 0.039 | 0.401 / 0.349 0.006 / -0.004 |
| Llama-3.2-Instruct-3B | 0.160 / 0.114 0.022 / 0.041 | 0.119 / 0.064 0.062 / 0.038 | 0.390 / 0.278 0.010 / -0.001 | 0.318 / 0.226 0.205 / 0.123 | 0.329 / 0.270 0.188 / 0.149 | 0.331 / 0.280 -0.018 / -0.021 | 0.281 / 0.378 0.070 / 0.309 | 0.297 / 0.206 0.008 / 0.006 | 0.322 / 0.230 0.056 / 0.021 | 0.283 / 0.227 0.067 / 0.074 | 0.291 / 0.238 0.004 / 0.001 |
| Phi-3.5-instruct-4B | 0.042 / 0.291 0.008 / 0.046 | 0.043 / 0.235 0.009 / 0.042 | 0.168 / 0.315 -0.003 / 0.004 | 0.067 / 0.079 0.013 / 0.006 | 0.183 / 0.183 0.009 / 0.010 | 0.157 / 0.333 0.005 / 0.011 | 0.223 / 0.323 0.110 / 0.208 | 0.136 / 0.142 0.002 / 0.001 | 0.160 / 0.168 -0.006 / 0.000 | 0.131 / 0.230 0.016 / 0.037 | 0.139 / 0.225 0.003 / -0.002 |
| Phi-4-instruct-4B | 0.166 / 0.040 0.037 / 0.018 | 0.213 / 0.085 0.076 / 0.064 | 0.222 / 0.177 -0.008 / 0.006 | 0.195 / 0.064 0.074 / 0.043 | 0.209 / 0.237 0.070 / 0.144 | 0.225 / 0.114 0.016 / 0.011 | 0.194 / 0.394 0.038 / 0.343 | 0.152 / 0.098 0.008 / 0.007 | 0.188 / 0.131 0.004 / 0.029 | 0.196 / 0.149 0.035 / 0.074 | 0.202 / 0.156 0.002 / -0.003 |
| Qwen2.5-Instruct-0.5B | 0.359 / 0.449 0.108 / 0.073 | 0.259 / 0.314 0.074 / 0.062 | 0.424 / 0.416 -0.014 / -0.005 | 0.338 / 0.354 0.046 / 0.036 | 0.357 / 0.337 0.040 / 0.038 | 0.427 / 0.386 -0.013 / 0.002 | 0.472 / 0.432 0.320 / 0.163 | 0.361 / 0.334 -0.007 / 0.012 | 0.389 / 0.339 -0.002 / -0.031 | 0.376 / 0.373 0.061 / 0.039 | 0.384 / 0.369 0.008 / 0.002 |
| Qwen2.5-Instruct-1.5B | 0.156 / 0.249 0.012 / 0.080 | 0.174 / 0.232 0.030 / 0.053 | 0.298 / 0.338 0.005 / 0.003 | 0.254 / 0.290 0.069 / 0.045 | 0.292 / 0.282 0.056 / 0.047 | 0.415 / 0.229 -0.027 / -0.024 | 0.471 / 0.430 0.205 / 0.157 | 0.298 / 0.208 0.005 / 0.004 | 0.306 / 0.243 -0.016 / 0.032 | 0.296 / 0.278 0.038 / 0.044 | 0.304 / 0.281 0.001 / -0.005 |
| Models | w.o. audit NDM/NAD | w. audit NDM/NAD |
|---|---|---|
| Llama-3.2-3B-Instruct | 0.283/0.056 | 0.264/0.058 |
| Phi-4-mini-Instruct | 0.196/0.035 | 0.179/0.034 |
| Qwen2.5-3B-Instruct | 0.297/0.021 | 0.284/0.019 |
| Qwen3-4B | 0.239/0.014 | 0.221/0.011 |
| Gemma-3-4B-it | 0.246/0.000 | 0.237/0.000 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Features | folds | Acc by Chance | Acc by features | |
|---|---|---|---|---|---|
| Emotion Stimulus | 241 | 8 | 5 | 0.1667 | 0.273639 0.0470 |
| Game (Focal Behavior) | Happy | Anger | Disgust | Fear | Sad | Surp. |
|---|---|---|---|---|---|---|
| Prisoner’s Dilemma (Cooperate) | ||||||
| Stag Hunt (Choose Stag) | ||||||
| Escalation Game (Persist) | ||||||
| Trust Game (Send/Trust) | ||||||
| Ultimatum Game (Reject) | ||||||
| Sealed-Bid (Overbidding) |
| Task family | Mean abs. error | Minimum discrimination | Stage 1 conclusion |
|---|---|---|---|
| Escalation Game | 0.0218 | 0.2952 | valid, but seed-unstable |
| Prisoners’ Dilemma | 0.0217 | 0.2773 | valid, but seed-unstable |
| Stag Hunt | 0.0189 | 0.2822 | valid, but seed-unstable |
| Trust Game (trustee) | 0.0670 | 0.3859 | valid, but seed-unstable |
| Trust Game (trustor) | 0.0624 | 0.4056 | valid, but seed-unstable |
| Ultimatum Game (proposer) | 0.0292 | 0.3287 | valid, but seed-unstable |
| Task family | Retained items | Mean discr. | MAE | Min discr. | Max | Max |
|---|---|---|---|---|---|---|
| Escalation Game | 12 | 1.18 | 0.018 | 0.52 | 0.24 | 0.19 |
| Prisoners’ Dilemma | 12 | 1.23 | 0.018 | 0.49 | 0.27 | 0.22 |
| Stag Hunt | 10 | 1.38 | 0.016 | 0.56 | 0.21 | 0.18 |
| Trust Game (trustee) | 12 | 1.02 | 0.054 | 0.51 | 0.24 | 0.20 |
| Trust Game (trustor) | 12 | 1.00 | 0.050 | 0.54 | 0.22 | 0.19 |
| Ultimatum Game (proposer) | 10 | 0.98 | 0.024 | 0.47 | 0.20 | 0.17 |
LLM Decision-Making
LLM decision-making studies how language models choose, act, seek information, and allocate resources under goals, uncertainty, constraints, and social pressures.
See all 242 papers