cs.AINov 2, 2026

ProofPaths: An AI Agent Framework for Assessing Student Reasoning

Authors: Mohsen Hariri, Vipin Chaudhary

Organizations: Case Western Reserve University Cleveland, Ohio, USA

Abstract

Students can use large language models to complete assignments, but a correct solution does not establish whether they understand the reasoning behind it. Individualized interviews can probe that understanding but require recurring staff effort. We introduce ProofPaths, an AI agentic framework that combines rubric-based grading with individualized and interactive interviews. Multiple grading agents assess a submission against instructor guidance, exchange critiques, and revise their judgments. Their scores determine which review supplies the grade and feedback. An interview agent asks students to justify steps in their submission and uses their answers to guide follow-up questions. Each question is linked to a retrieved submission excerpt, so instructors can compare the student's explanation with the cited passage. The system tracks assessment progress and stores grading reviews and interview transcripts for each submission. Several deterministic tests of the assessment controllers check source handling, score aggregation, and limits on correction attempts. Instructors can inspect all reviews and transcripts and override grades within the assignment workflow.

Figures & tables

Explore similar work

CardsList
  1. EDIT: Evidence-Diagnosed Intervention Training for Rule-Faithful LLM Grading

    Jun 4, 2026Zhihao Wu, Linhai Zhang, Taiyi Wang +4LLM-as-a-JudgeRubric-Based Evaluation

  2. TeachGrade: Training-Free Short Answer Scoring with Teacher Evidence

    Oct 10, 2026Jinhao Yan, Zhihong Shen, Shengjie Wang +4Automated GradingLLM-as-a-Judge

  3. CHiL(L)Grader: Calibrated Human-in-the-Loop Short-Answer Grading

    Mar 12, 2026Pranav Raikote, Korbinian Randl, Ioanna Miliou +2Automated GradingAI in Education