Structure of Basic Human Values in Russian Social Media
Organizations: Independent researcher, Lisbon, Portugal · UCL Institute of Education, London, United Kingdom
Abstract
What is known about the values of national populations rests almost entirely on questionnaires, which prompt respondents to rate researcher-supplied descriptions of each motivation. Social media instead records values as they are invoked spontaneously, in communication addressed to a real audience. We measure value expression in broadly sampled, heterogeneous Russian-language social-media data, where value-relevant content is sparse and often ambiguous, and read the result against the survey-based profile of the same population. To address subjectivity in value interpretation, we compare alternative LLM-prompt configurations against expert judgments and use error-driven calibration to select a theory-based operationalization. Using VKontakte data collected from one million randomly generated user IDs, comprising 7.5 million public text posts, we develop a multi-stage framework combining candidate selection, repeated LLM annotation, and transfer to an XLM-RoBERTa encoder for large-scale prediction (a macro PR-AUC of .60 on the expert benchmark, with continuous scores positively correlated with graded expert confidence across all ten values). The circular structure proposed by Schwartz is largely recovered (congruence .95 at the post level, .94 at the user level). The aggregate profile agrees with survey findings at the anchors - Benevolence highest and broadly distributed across users, Power lowest - but shows relatively elevated Hedonism and relatively low Universalism. Universalism is further displaced structurally, co-expressed with Security and Tradition and concentrated in the output of highly active users.
Figures & tables
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Value | P | R | F1 | OA | UA | |
|---|---|---|---|---|---|---|
| Benchmark 1 | ||||||
| Self-direction | .53 | .70 | .61 | .08 | .30 | .63 |
| Stimulation | .48 | .54 | .51 | .04 | .46 | .54 |
| Hedonism | .77 | .49 | .60 | .04 | .51 | .60 |
| Achievement | .72 | .70 | .71 | .04 | .30 | .68 |
| Power | .43 | .71 | .53 | .03 | .29 | .52 |
| Parameter | Configuration |
|---|---|
| Model | XLM-RoBERTa-large |
| Fine-tuned layers | Last two layers |
| Pooling | Mean pooling |
| Classification head | Linear multi-label head |
| Loss | Binary cross-entropy (BCE) |
| Batch size | 16 |
| Expert benchmark | Test | ||
|---|---|---|---|
| Value | Experts | Gemini | Gemini |
| Self-direction | .59 | .74 | .75 |
| Stimulation | .44 | .65 | .63 |
| Hedonism | .68 | .67 | .73 |
| Achievement | .73 | .81 | .79 |
| Power | .47 | .52 | .47 |
Computational Social Science
Computational social science uses data and computational models to study social behavior, institutions, communication, and collective outcomes.
See all 165 papers