Cross-Centaur: Modeling Individual Decision-Making Across Psychological Tasks with Language Models
Organizations: The University of Tokyo · RIKEN Center for Brain Science
Abstract
Large language models (LLMs) are increasingly used as computational models of human behavior. Recent models such as Centaur have advanced this goal by fine-tuning LLMs on trial-by-trial decisions from psychological experiments. However, existing large-scale behavioral datasets do not link the same participants across different tasks, so these models learn population-level regularities but are not trained to model individual-level regularities across tasks. We introduce Cross-Psych-101, a dataset of 591 participants and 261{,}551 valid decisions across 12 Bandit, Tradeoff, Structure, and Social tasks. We train Cross-Centaur to predict a participant's target-task actions from a target-task description and the source-task description paired with the same participant's source-task behavior. Cross-Centaur outperforms off-the-shelf LLMs and Centaur on held-out participants, both within and across tasks. Probing analyses suggest that its hidden states encode participant-level behavioral tendencies that transfer across tasks. These results highlight the potential of cross-task individual-level data for predicting human decision-making with language models. Cross-Pysch-101 is available at https://huggingface.co/datasets/HikaruAsano/cross-psych-101.
Figures & tables
| Model | Centaur | Cross-Centaur Same-Task | Cross-Centaur Cross-Task | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Overall | Bandit | Tradeoff | Structure | Social | Bandit | Tradeoff | Structure | Social | |||||
| Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | ||||||
| Qwen3-8B Base | 0.680 | 0.928 | 1.031 | 0.838 | 1.053 | 0.902 | 0.865 | 0.913 | 0.754 | 0.836 | 0.834 | 1.160 | 1.208 |
| Qwen3-8B w/ reasoning | 1.009 | 1.681 | 1.522 | 1.421 | 1.552 | 1.531 | 1.159 | 1.267 | 0.959 | 1.265 | 1.294 | 1.620 | 1.563 |
| Qwen3-8B w/ hints | 0.680 | 1.996 | 1.476 | 1.517 | 1.798 | 1.781 | 1.209 | 1.254 | 1.019 | 1.371 | 1.343 | 1.712 | 1.538 |
| Qwen3-14B Base | 0.672 | 0.916 | 1.025 | 0.847 | 1.022 | 0.907 | 0.883 | 0.898 | 0.735 | 0.828 | 0.819 | 1.136 | 1.181 |
| 2-Armed Bandit | Restless Bandit | Correlated Bandit | One-Shot Gamble | Temporal Discounting | Shuffled Card | Classification | Estimation | Odd One Out | Public Goods | Social Value | Ultimatum Game | |
| Qwen3-8B | 0.937 / 0.607 | 1.201 / 1.140 | 3.602 / 3.370 | 0.841 / 0.709 | 1.129 / 0.805 | 1.904 / 1.953 | 1.030 / 1.018 | 1.230 / 1.413 | 1.788 / 1.397 | 1.318 / 1.341 | 1.908 / 1.714 | 5.031 / 3.757 |
| Qwen3-14B | 1.290 / 0.616 | 1.416 / 1.362 | 4.235 / 4.860 | 0.970 / 0.812 | 1.638 / 0.617 | 2.162 / 2.325 | 1.526 / 1.727 | 1.265 / 1.498 | 1.324 / 1.217 | 1.390 / 1.359 | 3.164 / 2.202 | 6.525 / 4.747 |
| Centaur | 0.300 / 0.315 | 0.804 / 0.815 | 1.493 / 1.819 | 0.411 / 0.505 | 0.274 / 0.294 | 1.358 / 1.633 | 0.691 / 0.684 | 0.928 / 0.996 | 0.798 / 0.814 | 0.808 / 0.870 | 1.613 / 1.618 | 1.583 / 1.830 |
| Cross-Centaur | 0.294 / 0.313 | 0.786 / 0.808 | 1.462 / 1.780 | 0.411 / 0.520 | 0.269 / 0.292 | 1.365 / 1.630 | 0.681 / 0.676 | 0.925 / 0.987 | 0.803 / 0.821 | 0.810 / 0.865 | 1.629 / 1.649 | 1.554 / 1.777 |
| Bandit | Tradeoff | Structure | Social | |
|---|---|---|---|---|
| Qwen3-8B / Shuffled | 1.731 | 1.463 | 1.393 | 2.115 |
| Qwen3-8B / Target | 1.708 | 1.395 | 1.318 | 1.630 |
| Qwen3-8B / Orig | 1.689 | 1.336 | 1.403 | 1.756 |
| Centaur / Shuffled | 0.964 | 1.756 | 1.093 | 1.697 |
| Centaur / Target | 0.969 | 1.899 | 1.125 | 1.635 |
| Centaur / Orig | 0.932 | 1.580 | 1.081 | 1.612 |
| Model | Same-Task | Cross-Task | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bandit | Tradeoff | Structure | Social | Bandit | Tradeoff | Structure | Social | |||||
| Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | |||||
| Qwen3-8B | 0.724 | 0.759 | 0.567 | 0.603 | 0.583 | 0.567 | 0.531 | 0.438 | 0.533 | 0.533 | 0.596 | 0.574 |
| Centaur | 0.738 | 0.759 | 0.600 | 0.603 | 0.600 | 0.556 | 0.542 | 0.438 | 0.533 | 0.533 | 0.596 | 0.569 |
| Cross-Centaur | 0.734 | 0.760 | 0.633 | 0.603 | 0.634 | 0.609 | 0.749 | 0.477 | 0.567 | 0.632 | 0.608 | 0.553 |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Task Name | Category | Incentivized? | Reference | Summary |
|---|---|---|---|---|
| Two-armed bandit | Bandit | Yes | Gershman (2018) | Choose between a safe option (always yielding zero points) and a risky option (yielding a positive or negative reward). 10 trials 8 sessions; the risky option’s reward distribution varies across sessions. |
| Restless bandit | Bandit | Yes | Daw et al. (2006) | Choose one of four options whose expected rewards drift over time. 50 trials 2 sessions. |
| Correlated bandit | Bandit | Yes | Wu et al. (2018) | Choose one of thirty options arranged in a row, where neighboring options yield similar rewards. 10 sessions in total (5 long sessions of 10 trials and 5 short sessions of 5 trials); reward distributions and scales vary across sessions. |
| One-shot gamble | Tradeoff | Yes | Krueger et al. (2024) | Choose between two lotteries, each specified by probabilities and payoffs, for 20 trials. One chosen lottery is resolved at the end of the task. |
| Temporal discounting | Tradeoff | No | Ruggeri et al. (2022) | Choose between an immediate (sooner) and a delayed (later) monetary option across varying amounts and delays. 3 trials 4 sessions, covering both gain and loss conditions. |
| Shuffled card task | Tradeoff | Yes | Frey et al. (2017) | Repeatedly draw a card from a deck of 32 (containing gain and bomb cards) or stop. Drawing a bomb card forfeits the session’s accumulated points and ends the session. 35 sessions, varying in gain amount, loss amount, and number of bomb cards. |
| Setting | Value |
|---|---|
| Base model | Qwen3-8B |
| Training framework | Unsloth |
| Hardware | Eight NVIDIA GH200 Grace Hopper Superchip GPUs |
| Trainable parameters | LoRA adapter weights only |
| LoRA configuration | Rank , , dropout , no bias terms |
| LoRA target modules | q_proj , k_proj , v_proj , o_proj , gate_proj , up_proj , down_proj |
| Setting | Value |
|---|---|
| Model variants | Qwen3-8B, Centaur, and Cross-Centaur |
| Representation input | User-side prompt only; assistant target transcript excluded |
| Hidden-state layer | Final transformer layer |
| Pooling | Mean pooling over non-padding tokens |
| Model inference precision | 4-bit model loading with bfloat16 computation |
| Probe scope | Separate probe for each task |
| Task | Score Name | Type | Definition | Interpretation of Larger Values |
|---|---|---|---|---|
| Two-armed bandit | regret | performance | Negative mean regret, where regret is best reward minus realized reward. | Better choices. |
| Restless bandit | regret | performance | Negative mean regret, where regret is the maximum mean reward on each trial minus the realized reward. | Better choices. |
| Correlated bandit | regret | performance | Negative mean regret, where regret is rewardScale minus the realized reward. | Better choices. |
| One-shot gamble | risk preference | risk preference | Fraction of the 20 trials in which the participant chose the higher-variance option. | More risk-seeking choices. |
| Shuffled card tas | risk preference | risk preference | Number of sessions ending by drawing a bomb, divided by 35. | More sessions in which the participant continues drawing until a bomb. |
| Shuffled card task | risk preference | risk preference | Mean stopping trial among voluntarily stopped sessions, divided by 35. | Later stopping and stronger tendency to keep drawing. |
| Model | Cross-Centaur Same-Task | Cross-Centaur Cross-Task | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Bandit | Tradeoff | Structure | Social | Bandit | Tradeoff | Structure | Social | |||||
| Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | |||||
| Qwen3-8B-prompt Shuffled source | 2.076 | 1.822 | 1.431 | 2.569 | 1.837 | 1.281 | 1.488 | 1.080 | 1.368 | 1.379 | 2.031 | 1.746 |
| Qwen3-8B-prompt Target only | 1.907 | 1.709 | 1.374 | 1.638 | 1.751 | 1.465 | 1.432 | 1.044 | 1.303 | 1.277 | 1.628 | 1.624 |
| Qwen3-8B Original | 2.007 | 1.587 | 1.458 | 1.744 | 1.798 | 1.262 | 1.350 | 1.071 | 1.371 | 1.379 | 1.783 | 1.741 |
| centaur prompt Shuffled source | 1.071 | 2.218 | 1.146 | 1.709 | 0.987 | 0.834 | 1.761 | 1.291 | 1.078 | 1.055 | 1.691 | 1.691 |
| Model | Centaur | Cross-Centaur Same-Task | Cross-Centaur Cross-Task | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Overall | Bandit | Tradeoff | Structure | Social | Bandit | Tradeoff | Structure | Social | |||||
| Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | Same cat. | Other cat. | ||||||
| Centaur | |||||||||||||
| Cross-Centaur | |||||||||||||
| Cross-Psych-101 | |||
|---|---|---|---|
| Baseline | Psych-101 | Same-Task | Cross-Task |
| Qwen3-8B Base | 1.350 [1.232, 1.473] | 1.254 [1.051, 1.478] | 0.899 [0.666, 1.199] |
| Centaur | 0.008 [0.003, 0.014] | 0.110 [0.070, 0.170] | 0.150 [0.084, 0.241] |
| Model | Same-Task | Cross-Task | ||||||
|---|---|---|---|---|---|---|---|---|
| Bandit | Tradeoff | Structure | Social | Bandit | Tradeoff | Structure | Social | |
| Llama-3.2-1B | 1.193 / 1.040 | 1.865 / 1.590 | 1.197 / 1.095 | 1.574 / 1.531 | 1.057 / 0.908 | 1.420 / 1.149 | 1.192 / 1.030 | 1.800 / 1.667 |
| Llama-3.1-8B | 0.986 / 0.938 | 1.641 / 1.252 | 1.081 / 1.000 | 1.563 / 1.373 | 0.862 / 0.805 | 1.232 / 0.834 | 1.002 / 0.883 | 1.714 / 1.462 |
| Qwen3-1.7B | 0.906 / 0.861 | 1.155 / 1.028 | 0.994 / 0.871 | 1.128 / 1.082 | 0.917 / 0.853 | 1.028 / 0.868 | 1.040 / 0.869 | 1.330 / 1.222 |
| Qwen3-8B | 0.854 / 0.792 | 1.058 / 0.910 | 0.856 / 0.795 | 1.042 / 0.982 | 0.831 / 0.765 | 0.873 / 0.729 | 0.869 / 0.772 | 1.184 / 1.107 |