cs.CLSep 25, 2026

Modeling Student Sensemaking with LLMs and Knowledge-Graph-Guided Inference

Authors: Özge Alacam, Zübeyde Demet Kirbulut Güneş, Funda Ekici, Nurcan Turan-Oluk, Dilay Dinçdemir, Hakkı Kadayıfçı, Sevinç Nihal Yeşiloğlu, Burcu Işık, 

Organizations: Center for Information and Language Processing, LMU München, Munich, Germany · Department of Chemistry Education, Gazi Faculty of Education, Gazi University, Ankara, Türkiye

Abstract

Collaborative science learning requires nuanced interpretation of student dialogue to characterize how learners identify knowledge gaps, build explanations, and work toward resolution - a theory-driven analysis that is labor-intensive and difficult to scale. We investigate whether instruction-tuned large language models (LLMs) can support multidimensional analysis of collaborative sensemaking without task-specific training, and whether structured knowledge-state information improves model inference. We evaluate two mid-size LLMs on 23 richly annotated, expert-labeled episodes across prompting conditions that vary definitional scaffolding, reasoning mode, and turn structure. Without reasoning, models tend to overpredict successful sensemaking; reasoning-enabled prompting improves identification of unsuccessful cases. Knowledge-state diagnostics provide additional grounding, improving detection of unsuccessful sensemaking and increasing agreement with expert annotations. No single configuration performs best across all sensemaking dimensions, underscoring the multidimensional nature of the task.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Hey Chat, Can You Teach Me? Structuring Socratic Dialogue for Human Learning in the Wild

    Jun 10, 2026Sidney Tio, Arunesh Sinha, Pradeep VarakanthamIntelligent Tutoring SystemsAI in Education

  2. Do Large Language Models Mentalize When They Teach?

    Apr 2, 2026Sevan K. Harootonian, Mark K. Ho, Thomas L. Griffiths +2Theory of Mind

  3. LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue

    Sep 2, 2025Katharine Kowalyshyn, Matthias ScheutzLLM EvaluationTheory of Mind