Students can use large language models to complete assignments, but a correct solution does not establish whether they understand the reasoning behind it. Individualized interviews can probe that understanding but require recurring staff effort. We introduce ProofPaths, an AI agentic framework that combines rubric-based grading with individualized and interactive interviews. Multiple grading agents assess a submission against instructor guidance, exchange critiques, and revise their judgments. Their scores determine which review supplies the grade and feedback. An interview agent asks students to justify steps in their submission and uses their answers to guide follow-up questions. Each question is linked to a retrieved submission excerpt, so instructors can compare the student's explanation with the cited passage. The system tracks assessment progress and stores grading reviews and interview transcripts for each submission. Several deterministic tests of the assessment controllers check source handling, score aggregation, and limits on correction attempts. Instructors can inspect all reviews and transcripts and override grades within the assignment workflow.
Figures & tables
Fig. 1: Grading and interviewing use the same submission. Grading agents exchange critiques and revise their assessments before one review supplies the grade and feedback. The interview agent asks about submission excerpts and follows up on the student’s answers. The interview proceeds independently of grading.
Fig. 2: A least-squares interview probes the assumption behind a correct calculation. The student’s first explanation overlooks the rank condition; the follow-up changes the feature matrix to test that explanation. The exchange and understanding labels are authored illustrations.
Fig. 3: Course access and persistent assessment state are managed by Go and PostgreSQL. Python coordinates parsing and agent workflows, with Redis for completed outputs and work leases. Institutional HPC resources serve model inference. Results and stored progress reach the browser through Go.
Input or perturbation
Observed behavior
Valid excerpt identifier
Exact excerpt
Unknown excerpt identifier
Rejected
Reuse with unused excerpts
Rejected
Reuse after excerpt exhaustion
Accepted
Altered stored source text
Rejected
Unrelated question, valid identifier
Accepted
TABLE I: Controller behavior in nine deterministic probes with synthetic inputs and scripted agent responses. Acceptance denotes passing the implemented checks.