Reasoning under uncertainty in humans and language models
Organizations: Equal contribution · ETH AI Center, Zürich, Switzerland · Institute for Neuroinformatics, University of Zürich & ETH Zürich, Switzerland · ETH Zürich, Switzerland ·
Abstract
Do language models make decisions under uncertainty like humans do? And if so, what role does extended reasoning play in the underlying decision process? We answer this question by introducing an active probabilistic reasoning task that cleanly separates sampling (actively acquiring evidence) from inference (integrating evidence towards a decision). Benchmarking humans and a broad set of contemporary LLMs against an optimal reference policy reveals a consistent pattern: extended reasoning is the key determinant of strong performance, driving large gains in inference, while yielding only modest improvements in active sampling. To explain these differences, we fit a behavioral model that captures systematic deviations from optimal Bayesian behavior through interpretable parameter families, placing humans and models in a shared low-dimensional cognitive space. The resulting fits show how reasoning shifts models toward human-like regimes of evidence accumulation and belief-to-choice mapping, and yield testable predictions about the latent dynamics that might drive each decision. Probing residual-stream activations of an open-weight reasoning model, we find that the geometry of internal representations tracks these predicted dynamics, linking behavior to representational correlates of the fitted latent dynamics.
Figures & tables
Appendix figures & tables23 assets
Supplementary material from the paper’s appendix.
Appendix
| Predictors | Success rate | Bias spread | |||
|---|---|---|---|---|---|
| Model size | 0.088 | 0.116 | 0.147 | 0.059 | 0.084 |
| Architecture | 0.416 | 0.002 | 0.555 | 0.172 | 0.004 |
| Training regime | 0.862 | 0.068 | 0.589 | 0.305 | 0.319 |
| Model size + architecture | 0.428 | 0.154 | 0.561 | 0.172 | 0.173 |
| Training regime + architecture | 0.906 | 0.105 | 0.756 | 0.338 | 0.348 |
| Model size + training regime | 0.889 | 0.214 | 0.666 | 0.333 | 0.433 |
| Model | Reasoning | LLM loss | Human loss | Diff | 95% CI | (raw) | Sig. | |
|---|---|---|---|---|---|---|---|---|
| gpt-5-mini | base | 5400 | 0.079 | 0.015 | -0.064 | [-0.083, -0.045] | ||
| grok-3-mini | base | 5800 | 0.062 | 0.015 | -0.047 | [-0.066, -0.029] | ||
| gemini-2.5-flash | base | 2800 | 0.074 | 0.015 | -0.060 | [-0.083, -0.037] | ||
| gemini-2.5-pro | base | 2800 | 0.071 | 0.015 | -0.056 | [-0.079, -0.033] | ||
| gpt-oss-120b | base | 2800 | 0.076 | 0.015 | -0.062 | [-0.085, -0.039] | ||
| gpt-5 | base | 2800 | 0.073 | 0.015 | -0.058 | [-0.081, -0.035] |
| Model | Reasoning | LLM loss | Human loss | Diff | 95% CI | (raw) | Sig. | |
|---|---|---|---|---|---|---|---|---|
| gpt-5-mini | base | 5400 | 0.114 | 0.058 | -0.056 | [-0.073, -0.039] | ||
| grok-3-mini | base | 5800 | 0.017 | 0.058 | +0.040 | [+0.026, +0.054] | ||
| gemini-2.5-flash | base | 2800 | 0.228 | 0.058 | -0.171 | [-0.194, -0.148] | ||
| gemini-2.5-pro | base | 2800 | 0.188 | 0.058 | -0.130 | [-0.153, -0.107] | ||
| gpt-oss-120b | base | 2800 | 0.088 | 0.058 | -0.031 | [-0.051, -0.011] | 0.001900 | ** |
| gpt-5 | base | 2800 | 0.156 | 0.058 | -0.098 | [-0.121, -0.077] |
| 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 41.7 | 48.5 | 54.2 | 58.9 | 62.8 | 66.3 | 69.3 | 72.0 | 74.4 | 76.6 | 78.5 | 80.3 | 81.9 | 83.4 |
| Setting | Symbol | Selected value |
|---|---|---|
| Choice likelihood weight | ||
| Sampling-bias regularizer | ||
| Inertia regularizer | ||
| Memory bound | ||
| Sampling-gain bound | ||
| Inertia bound |
| Model | Reasoning | eLPD/game | CI low | CI high | p-value | FI |
|---|---|---|---|---|---|---|
| Optimal agent (DP) | – | 8.953 | 8.707 | 9.196 | 0.001 | 99.6% |
| Humans | – | 6.518 | 6.401 | 6.636 | 0.001 | 98.1% |
| Base models | ||||||
| gpt-5-mini | Base | 6.962 | 6.756 | 7.160 | 0.001 | 98.6% |
| grok-3-mini | Base | 7.354 | 7.159 | 7.548 | 0.001 | 98.4% |
| gemini-2.5-flash | Base | 7.716 | 7.492 | 7.936 | 0.001 | 99.5% |
| Model | Reasoning | |||||||
|---|---|---|---|---|---|---|---|---|
| Optimal agent (DP) | – | [0.252, 0.250, 0.246, 0.252] | [0.238, 0.220, 0.251, 0.292] | -0.004 | 3.763 | 0.646 | 10.513 | 55.004 |
| Humans | – | [0.279, 0.268, 0.232, 0.221] | [0.257, 0.261, 0.239, 0.243] | 0.081 | 1.742 | 0.059 | 1.707 | 29.322 |
| gpt-5-mini | Base | [0.594, 0.285, 0.098, 0.023] | [0.467, 0.317, 0.160, 0.056] | -0.101 | 0.602 | 0.415 | 1.230 | 5.676 |
| gpt-5-mini | Extended | [0.359, 0.281, 0.232, 0.129] | [0.364, 0.294, 0.208, 0.135] | -0.019 | 0.701 | 0.257 | 1.992 | 8.590 |
| grok-3-mini | Base | [0.289, 0.329, 0.207, 0.176] | [0.392, 0.273, 0.192, 0.143] | -0.012 | 0.665 | 0.050 | 1.709 | 12.040 |
| grok-3-mini | Extended | [0.313, 0.309, 0.216, 0.163] | [0.379, 0.304, 0.185, 0.132] | 0.013 | 0.675 | 0.050 | 1.941 | 9.119 |
| Model | Reasoning | Train NLL | Test NLL | NLL |
|---|---|---|---|---|
| Optimal agent (DP) | – | 0.303 | 0.303 | 0.303 |
| Humans | – | 0.657 | 0.657 | 0.657 |
| gpt-5-mini | Base | 0.613 | 0.615 | 0.615 |
| gpt-5-mini | Extended | 0.653 | 0.654 | 0.654 |
| grok-3-mini | Base | 0.664 | 0.666 | 0.666 |
| grok-3-mini | Extended | 0.710 | 0.712 | 0.712 |
Decision-Making under Uncertainty
Decision-making under uncertainty studies how to choose actions when outcomes, states, or models are imperfectly known.
See all 213 papers