Personality-Driven Student Agent-Based Modeling in Mathematics Education: How Well Do Student Agents Align with Human Learners?
Organizations: University of Florida
Abstract
It is crucial to explore the impact of different teaching methods on student learning in educational research. However, real-person experiments face significant ethical constraints, and we cannot conduct repeated teaching experiments on the same student. LLM-based generative agents offer a promising avenue for simulating student behavior. Before large-scale experiments, a fundamental question must be addressed: are student agents truly credible, and can they faithfully simulate human learning? In this study, we built a Big Five Personality-based student agent model with a full pipeline of student-teacher interaction, self-study, and examination. To evaluate behavioral fidelity, we collected 13 empirical studies on Big Five traits and learning, and distilled them into 14 criteria. We found that the 71.4% of the student agents' behavior was aligned with human learners.
Figures & tables
| Research Category | Key Studies | Score |
|---|---|---|
| General Meta-Analyses | Poropat (2009) , Mammadov (2022) , Meyer et al. (2023) | 2.5/3 |
| Mathematics-Specific Studies | Russo et al. (2014) , Meyer et al. (2019) , Koner et al. (2023) , Cirila et al. (2015) , Lipnevich et al. (2016) | 3/5 |
| Teacher Interaction | Mammadov and Avci (2024) , Meyer et al. (2023) | 1/2 |
| Learning Behavior | Komarraju et al. (2009) , Komarraju et al. (2011) | 1.5/2 |
| Self-Regulation | Schouwenburg and Lay (1995) , Lee et al. (2006) | 2/2 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Math Type | Number of Questions |
|---|---|
| Algebra | 1,341 |
| Geometry | 672 |
| Counting & Probability | 547 |
| Number Theory | 484 |
| Total | 3,044 |
| Category | Parameter | Value |
| Model | Student Temperature | 0.5 |
| Teacher Temperature | 0.3 | |
| Max New Tokens | 500 | |
| Learning | Learning Rounds | 10 / 20 / 50 |
| Retrieve Threshold | 0.7 | |
| Retrieve Top- | 1 |
| Study | Key Findings | Sample Size | Alignment |
| General Meta-Analyses | |||
| Poropat (2009) | Agreeableness, Conscientiousness, and Openness all predict academic performance. The relationship between Conscientiousness and achievement holds independently of intelligence, suggesting it reflects students’ willingness rather than ability. | Partial | |
| Mammadov (2022) | Conscientiousness is the strongest predictor of academic performance, accounting for 28% of explained variance even after controlling for cognitive ability. Extraversion and openness plays a more important role in earlier schooling, while high Neuroticism is consistently associated with heightened anxiety and poorer examination performance. | Accurate | |
| Meyer et al. (2023) | The relationship between personality and achievement varies meaningfully by subject domain. Neuroticism shows stronger negative associations with STEM achievement than with language subjects, while Conscientiousness remains a reliable predictor across domains. | Accurate | |
| Mathematics-Specific Studies | |||
| Russo et al. (2014) | Among all Big Five traits, Openness is the strongest predictor of mathematics test performance. High self-efficacy, low math anxiety, and low impulsivity also independently contribute to better outcomes. | Accurate | |
| Study | Key Findings | Sample Size | Agent Alignment |
| Teacher Interaction and Learning Engagement | |||
| Mammadov and Avci (2024) | Agreeable and Conscientious students tend to build stronger, more positive relationships with teachers, while Neuroticism — particularly its lower-order facets of anxiety, fear, and anger — is associated with poorer quality teacher–student interactions. | Partial | |
| Meyer et al. (2023) | High-extraversion students participate more actively in class and receive more favorable teacher evaluations, especially in language subjects where oral performance is valued. High-agreeableness students behave in a friendly manner in the classroom, and teachers may be more lenient with them when grading. | Partial | |
| Learning Behavior and Motivation | |||
| Komarraju et al. (2009) | Conscientiousness, Extraversion, and Openness are positively associated with mastery goal orientation and intrinsic motivation. In contrast, high Neuroticism and low Extraversion are linked to fear of failure and avoidance motivation — patterns characterized by withdrawal, anxiety, and disengagement from academic tasks. | Accurate | |
| Komarraju et al. (2011) | Conscientiousness and Agreeableness are positively correlated with all four learning styles examined (synthesis analysis, methodical study, fact retention, and elaborative processing), while Neuroticism is negatively correlated with all four. Together, the Big Five traits account for 14% of the variance in GPA. | Partial | |