A Foundation Model to Measure and Predict Human Behaviour
Organizations: State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · Yuanpei College, Peking University · School of Psychological and Cognitive Sciences, Peking University
Abstract
Large language models (LLMs) are increasingly used to infer psychological attributes, predict individual behaviour, and simulate human populations. However, despite generating plausible responses, they often misrepresent individuals and distort population statistics. Here we introduce Chiron, a foundation model to measure and predict human behaviour. We jointly fine-tune an LLM to represent psychological constructs, predict individual behaviour, and align population response distributions with human statistics. The training and evaluation data span 36 behavioural domains and 78 social science experiments, comprising 288,307 person records, 1,411,750 atomic behavioural decisions, and 99,953 psychometric assessments over 109 psychological constructs. In our evaluations, Chiron's psychological measurements agree more closely with human self-reports and exhibit fewer biases that undermine psychometric validity. It predicts individual behaviour more accurately than frontier LLMs (up to 28.4% relative improvement). In simulations of social science experiments, it more accurately captures the direction and magnitude of human experimental effects (82.2--94.3% lower effect-size estimation error). Together, these results establish Chiron as a unified computational instrument for measuring and predicting human behaviour.
Figures & tables
| Task & data category | Representative sources & constructs | Formulation (Input Target) & concrete example |
| 1. Psychological measurement | ||
| Scale: 53,073 train records, 10,820 eval records; 99,953 psychometric assessments across 109 constructs | ||
| Human writing with self-reports | COVID-19 RW3D (anger, anxiety), Buechel empathy, PANDORA (Big Five), PsihoRo (PHQ-9 depression, GAD-7 anxiety), Student-SADD (PHQ-9 depression), myPersonality (Big Five, train only) | Input : Author’s essays, reflections, or Reddit posts. Target : Author’s self-reported scale score. Example: “I have barely slept all week worrying whether my parents will catch the virus…” Anxiety . |
| Human questionnaires | 12 instruments: 16PF, AS+SC+AD+DO, Big Five, IPIP-FFM, HEXACO, DASS, ECR, RSE, SD3, MACH-IV, RIASEC, HSNS+DD | Input : Observed subset of a respondent’s questionnaire answers. Target : Construct score computed from withheld items on the questionnaire. Example: Observed responses on openness and agreeableness items Extraversion score on withheld items ( ). |
| Synthetic questionnaires & calibrated narratives | All 109 constructs across 5 families (IPIP, HEXACO, DASS, ERQ, IRI, Schwartz values, MFQ-2 morality, Hofstede, BIS/BAS, NFC) | Input : Simulated item answers or first-person narratives controlled for direction, evidence strength, setting, and length. Target : Instrument score or Bradley–Terry score. Example: Narrative describing reorganizing a team schedule after a setback Conscientiousness . |
| Nomological validity cohorts (evaluation only) | PAN15 social media, Pennebaker Essays, European Social Survey (ESS09); 150 literature construct pairs (60 constructs) | Input : Unlabelled posts, essays, or survey responses for each person in a cohort. Target: Published correlation between construct pairs in the psychological literature (evaluated against correlations of Chiron-inferred scores across cohort members). Example: Inferred Depression and Anxiety correlate positively across individuals ( ), matching published benchmarks. |
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Domain / source | Psychological construct | Data format | Training records | Eval. records | Eval. split |
|---|---|---|---|---|---|
| Personal writing and social-media records | |||||
| COVID-19 RW3D [ van der Vegt and Kleinberg, 2023 ] | Anger and anxiety | Personal writing with self-reported scores | M: 1,357 | M: 1,133 | Participants |
| Buechel empathy [ Buechel et al., 2018 ] | Empathic concern | Written reactions with self-reported scores | M: 1,009 | M: 842 | Participants |
| myPersonality [ Kosinski et al., 2013 ] | Big Five traits | Social-media writing with assessment scores | M: 56 | — | Participants |
| PAN15 Author Profiling [ Rangel et al., 2015 ] | All 109 constructs (nomological validity) | Social-media writing | — | M: 577 | Evaluation only |
| PANDORA [ Gjurković et al., 2021 ] | Big Five traits | Reddit records with scores and trait categories | M: 854 P: 1,275 | M: 693 P: 71 | Authors within each objective |
| Study | Split | Conditions | Respondents | Decisions | Effects |
|---|---|---|---|---|---|
| Train studies (63) | |||||
| AMJ_10_2 | train | 4 | 196 | 2,940 | 3 |
| AMJ_1_3 | train | 10 | 922 | 5,532 | 2 |
| AMJ_2_2 | train | 6 | 307 | 3,070 | 3 |
| AMJ_3_2 | train | 4 | 78 | 78 | 2 |
| AMJ_3_3 | train | 4 | 122 | 2,806 | 7 |
| # | Construct | Reference | Definition |
|---|---|---|---|
| Broad personality and vocational interests (24) | |||
| 1 | openness | IPIP | A stable tendency to be curious about and receptive to new ideas, aesthetics, imagination, and varied experiences. |
| 2 | conscientiousness | IPIP | A stable tendency to be organized, self-disciplined, dependable, and persistent in pursuing goals and standards. |
| 3 | extraversion | IPIP | A tendency to seek and enjoy social interaction and high activity, expressed through energy, enthusiasm, and sociability. |
| 4 | agreeableness | IPIP | A stable tendency to treat others with trust, cooperation, consideration, and tolerance. |
| 5 | neuroticism | IPIP | A tendency to experience negative emotions and stress reactions, such as anxiety, sadness, and anger, frequently and intensely. |
| Metric | Eligible comparisons | Value |
| MAE | 148 | 0.0120 |
| Pearson | 148 | 0.9990 |
| Direction accuracy | 218 | 0.9771 |
| Significance F1 | 319 | 0.9804 |
| Distribution NMAE | 175 | 0.0102 |
| Setting | Value |
| Adaptation | LoRA (applied to linear layers), rank 32, scaling 64 |
| LoRA dropout | 0 |
| Epochs | 2 |
| Optimizer | AdamW |
| Learning rate | |
| Schedule | Cosine decay; 3% warmup |
| Dataset | Construct | Chiron | GPT-6 Sol | Claude Opus 5.5 | DeepSeek-V4.1-Flash | Qwen3.6-35B-A3B | |||||
| MAE | MAE | MAE | MAE | MAE | |||||||
| covid19_real_world_worry_rw3d | Anger | 0.4557 | 0.4094 | 0.3991 | 0.4994 | 0.3870 | 0.5444 | 0.3648 | 0.5036 | 0.3458 | 0.5720 |
| covid19_real_world_worry_rw3d | anxiety | 0.6386 | 0.3243 | 0.6367 | 0.3270 | 0.5979 | 0.3384 | 0.6181 | 0.3318 | 0.5454 | 0.3801 |
| empathic_reactions_buechel2018 | Empathic Concern | 0.4728 | 0.4296 | 0.3321 | 0.5916 | 0.3943 | 0.5878 | 0.3924 | 0.5534 | 0.3627 | 0.5987 |
| pandora | agreeableness | 0.2507 | 0.5346 | 0.2951 | 0.5644 | 0.2898 | 0.5461 | 0.2982 | 0.5428 | 0.2559 | 0.5428 |
| pandora | conscientiousness | 0.2662 | 0.5256 | 0.1924 | 0.6020 | 0.1271 | 0.5811 | 0.1484 | 0.5677 | 0.1332 | 0.5852 |
| Dataset | People | Relation | Sign agreement | MAE |
| PAN15 | 577 | 0.8160 | 92.00% | 0.3004 |
| Essays | 2,467 | 0.8060 | 91.33% | 0.3027 |
| ESS09 | 4,921 | 0.8191 | 93.33% | 0.3538 |
| Trait | Score source | Mean | SD | SD ratio | MAE | |
|---|---|---|---|---|---|---|
| Agreeableness | Self-report | 677 | -0.159 | 0.618 | 1.000 | – |
| Chiron | 677 | -0.076 | 0.376 | 0.608 | 0.531 | |
| GPT-6 Sol | 677 | 0.117 | 0.343 | 0.554 | 0.564 | |
| Claude Opus 5.5 | 677 | 0.055 | 0.327 | 0.529 | 0.543 | |
| DeepSeek-V4.1-Flash | 677 | 0.052 | 0.312 | 0.504 | 0.540 | |
| Qwen3.6-35B-A3B | 677 | -0.029 | 0.406 | 0.657 | 0.538 |
| Diagnostic | Chiron | GPT-6 Sol | Claude Opus 5.5 | DeepSeek-V4.1-Flash | Qwen3.6-35B-A3B | |
| Irrelevant context | 543 | 0.0238 | 0.0433 | 0.0560 | 0.0730 | 0.0850 |
| Evidence order | 540 | 0.0270 | 0.0433 | 0.0655 | 0.0684 | 0.1139 |
| Metric | Evidence type | Chiron | GPT-6 Sol | Claude Opus 5.5 | DeepSeek-V4.1-Flash | Qwen3.6-35B-A3B | |
| Stepwise monotonicity | Questionnaire evidence | 541 | 99.45% | 93.97% | 90.46% | 84.50% | 67.24% |
| Narrative evidence | 325 | 94.70% | 94.34% | 87.26% | 88.02% | 67.99% | |
| Direction accuracy | Questionnaire evidence | 541 | 100.00% | 99.27% | 98.35% | 97.06% | 96.51% |
| Narrative evidence | 325 | 100.00% | 99.08% | 99.39% | 99.69% | 98.47% | |
| Real personal records | 592 | 93.82% | 96.36% | 88.36% | 92.49% | 87.57% |
| Domain | Chiron | GPT-6 Sol | Claude Opus 5.5 | DeepSeek-V4.1-Flash | Qwen3.6-35B-A3B | |
| Held-out individuals: 25 domains represented in prediction training | ||||||
| 16PF | 200 | |||||
| AS+SC+AD+DO | 50 | |||||
| Big Five | 200 | |||||
| Blog | 200 | |||||
| CFCS | 200 | |||||
| Model | MAE | Pearson | Direction | Sig. F1 | Dist. NMAE |
| Chiron | 0.2239 | 0.8729 | 0.9048 | 0.6780 | 0.0755 |
| GPT-6 Sol | 3.8951 | 0.5397 | 0.7857 | 0.7750 | 0.1638 |
| Claude Opus 5.5 | 1.9565 | 0.7032 | 0.8333 | 0.7407 | 0.1402 |
| DeepSeek-V4.1-Flash | 1.2542 | 0.6787 | 0.8095 | 0.7436 | 0.1255 |
| Qwen3.6-35B-A3B | 0.7977 | 0.6730 | 0.8095 | 0.7848 | 0.1248 |