Stan: An LLM-based thermodynamics course assistant
Organizations: Department of Chemical and Biomolecular Engineering, Allan P. Colburn Laboratory, University of Delaware, Newark, DE 19716, USA · W. L. Gore & Associates Inc., 100 Airport Road, Elkton, MD 21921, USA
Abstract
Discussions of AI in education focus predominantly on student-facing tools -- chatbots, tutors, and problem generators -- while the potential for the same infrastructure to support instructors remains largely unexplored. We describe Stan, a suite of tools for an undergraduate chemical engineering thermodynamics course built on a data pipeline that we develop and deploy in dual roles: serving students and supporting instructors from a shared foundation of lecture transcripts and a structured textbook index. On the student side, a retrieval-augmented generation (RAG) pipeline answers natural-language queries by extracting technical terms, matching them against the textbook index, and synthesizing grounded responses with specific chapter and page references. On the instructor side, the same transcript corpus is processed through structured analysis pipelines that produce per-lecture summaries, identify student questions and moments of confusion, and catalog the anecdotes and analogies used to motivate difficult material -- providing a searchable, semester-scale record of teaching that supports course reflection, reminders, and improvement. All components, including speech-to-text transcription, structured content extraction, and interactive query answering, run entirely on locally controlled hardware using open-weight models (Whisper large-v3, Llama~3.1 8B) with no dependence on cloud APIs, ensuring predictable costs, full data privacy, and reproducibility independent of third-party services. We describe the design, implementation, and practical failure modes encountered when deploying 7--8 billion parameter models for structured extraction over long lecture transcripts, including context truncation, bimodal output distributions, and schema drift, along with the mitigations that resolved them.
Figures & tables
| Level | Title | Primary Role | Capabilities |
|---|---|---|---|
| 1 | Resource Pointer | Indexer | • Points to textbook sections or course materials • Acts as a smart search tool without explanations |
| 2 | Content Summarizer | Summarizer | • Summarizes textbooks, lectures, or documents • Produces concise, digestible content |
| 3 | Concept Explainer | Tutor | • Explains concepts in plain language; Uses examples, analogies, and context • Answers why and how questions |
| 4 | Guided Problem Solver | Step-by-step Instructor | • Solves problems step-by-step; Provides hints and guiding questions • Identifies common mistakes |
| 5 | Exercise Generator | Practice Designer | • Suggests custom exercises and practice problems • Tailors questions to the topic without tracking performance |
| 6 | Autonomous Learning Companion | AI Collaborator | • Engages in Socratic-style dialogue; Supports metacognitive thinking • Integrates cross-subject concepts |
| Metric | Baseline | Full corpus |
|---|---|---|
| Lectures | 1 | 39 |
| Audio duration | 55.0 min | 35.7 hr |
| Transcription time | 177 s (18.6 ) | 43.7 min (49 ) |
| Raw segments | 826 | 20,361 |
| Hallucination loops | 4 | 1 |
| Segments removed | 53 (6.4%) | 4 (0.02%) |
| Metric | Kaltura | Whisper |
|---|---|---|
| Mean word count | 7,449 | 7,409 |
| Word count ratio | 0.99–1.01 | |
| “entropy” (total) | 329 | 331 |
| “enthalpy” (total) | 50 | 49 |
| “reversible” (total) | 87 | 81 |
| “thermodynamic(s)” (total) | 117 | 115 |
| Intended | Kaltura | Whisper |
|---|---|---|
| the next module | the next logro | the next module |
| liquid versus gases | liquid versus gaffy | liquids versus gases |
| a balance of the enthalpies | a balance of the envelopes of the trees | enthalpies |
| Gibbs and Helmholtz free energies | ideas and compulse free energies | gives and compulse for energies |
| keeping your protons | keeping your protein | keeping your protons |
| keeping your quarks | keeping your torch | keeping your quarks |
Generative AI in Education
Generative AI in education uses language and multimodal models to support teaching, learning, feedback, assessment, and educational design.
See all 287 papers