Overview

Automated grading studies how to assess student work consistently, from short answers and essays to mathematical reasoning, handwritten exams, and programming assignments. Approaches include fine-tuned language models and encoders, rubric-guided LLM judges, and vision-language systems that read handwritten work; many combine scores with explanations or route uncertain cases to human graders. Systems are commonly evaluated against expert marks using agreement and error measures, with benchmarks testing transfer across subjects, questions, and scoring rubrics. A central challenge is handling partial or ambiguous answers reliably while avoiding bias, prompt sensitivity, and overconfidence, so human oversight remains important, especially for high-stakes decisions.

Latest papers

CardsList

98 papers7 papers in the last four weeks, down 12% on the four weeks before. 0.1% of all new papers.

  1. Stress Testing a Multimodal Large Language Model Grading Assistant on Kinematics Graph Reading

    Nov 17, 2026Ons Zammel, Carlos Soares, Flávia Carvalhido +1Automated GradingMLLM Evaluation

  2. Validating LLM-Based Essay Scorers: A Comparative Analysis in Critical Online Reasoning in Medical Education

    Nov 16, 2026Daniel Baumartz, Alexander Mehler, Mevlüt Bagci +1Automated Essay ScoringAutomated Grading

  3. Reliability of Claude Code as an Agentic AI Grading System for Handwritten University Exams

    Nov 9, 2026Rayed AlGhamdiAutomated GradingEducational Assessment

  4. One Scale, Four Texts: Gaps, Overlaps and Silent Repairs in Published Grading Schemes

    Nov 4, 2026Elisa Rovai, Fabio RovaiDiabetic Retinopathy GradingAutomated Grading

  5. ProofPaths: An AI Agent Framework for Assessing Student Reasoning

    Nov 2, 2026Mohsen Hariri, Vipin ChaudharyEducational AssessmentAI in Education

  6. Rubric-Based Assessment of Student Reports Using Small Language Models

    Nov 1, 2026Sandesh Kumar Kafle, Jan Vykopal, Valdemar ŠvábenskýAutomated GradingRubric-Based Evaluation

  7. Beyond Response Scoring: An AI-aware Cognitive Supervision Framework for Automated Mathematical Short Answer Grading

    Oct 30, 2026Shengran Guo, Min Chi, Feifei Qiao +1Automated GradingGenerative AI in Education

  8. Can LLMs Reliably Grade Olympiad Proofs? A Study of Mathematical Verification with LLMs

    Oct 27, 2026Azim Ospanov, Zijin Feng, Ding Ding +5Automated GradingLanguage Model Reasoning Evaluation

  9. Machine--human agreement in marking undergraduate assignments is specific to model, prompt and institution

    Oct 13, 2026Giulio Corsi, Maryam Abo-Tabik, Yael Benn +4Automated GradingLLM-as-a-Judge

  10. TeachGrade: Training-Free Short Answer Scoring with Teacher Evidence

    Oct 10, 2026Jinhao Yan, Zhihong Shen, Shengjie Wang +4Automated GradingLLM-as-a-Judge

  11. Who Verifies the Verifier? Co-Evolving Inspectable Graders with Self-Improving Agents

    Oct 8, 2026Xing Zhang, Guanghui Wang, Yanwei Cui +4Automated EvaluationLLM Agent Self-Improvement

  12. Alice: A Large-Scale German Benchmark for Rubric-Based Multi-Dimensional Automatic Short Answer Scoring

    Oct 7, 2026Zhifan Sun, Sebastian Gombert, Jannik Lossjew +6Automated GradingEducational Assessment

  13. Rubric Spans are Label Representations: Joint LLM Encoding for Short Answer Scoring

    Oct 7, 2026Zhifan Sun, Sebastian Gombert, Fabian Zehner +3Automated GradingRubric-Based Evaluation

  14. LENS-GRF: Permutation-Invariant Lesion Evidence Network with Gated Residual Fusion for Acne Severity Grading and Multi-Rater Clinical Oracle Analysis

    Sep 25, 2026Muhammad Muhtasim Shahriar, M. F. Mridha, Md. Rakibul IslamSet TransformerAutomated Grading

  15. Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams

    Sep 24, 2026Ali Habibullah, Yazan Alshoibi, Mohammad Alshiekh +2Prompt SensitivityLLM-as-a-Judge

  16. ImpossibleRubrics: Stress-Testing Generated Rubrics as Reward Signals

    Sep 15, 2026Bowen Qin, Yi Xie, Yesheng Liu +1Reward HackingLanguage Model Generation Evaluation

  17. Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education

    Sep 4, 2026Rayed AlGhamdiGenerative AI in EducationHuman Oversight of AI

  18. A Human-in-the-Loop Framework for AI-Assisted Scoring in Large-Scale Writing Assessment

    Sep 4, 2026María Eugenia Curi, Germán Capdehourat, Isabel Amigo +4Educational AssessmentAutomated Grading

  19. Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation

    Aug 30, 2026Nishant Balepur, Paiheng Xu, Wei Ai +3LLM EvaluationMultiple-Choice Question Answering

  20. Large Scale AI Grading of Handwritten Physics Assessments: Score Agreement and Olympiad Team Selection Outcomes

    Aug 20, 2026Praveen Pathak, Siddharth Tiwary, Charudatt Kadolkar +4Automated GradingEducational Assessment

  21. Measuring the Partial-Credit Gap: A Strict Benchmark on Vietnam's 2025 Convex Marking Scheme

    Aug 18, 2026Nguyen Quoc Hung, Nguyen Dang Minh, Le Nhu Quynh +2Educational AssessmentBenchmark Validity

  22. Grading Needs a Rubric, Not Intelligence

    Aug 18, 2026Jhen-Ke LinAutomated GradingRubric-Based Evaluation

  23. WebGrader: Training LLMs for Web Development with Self-Evolving Programmatic Grader

    Aug 6, 2026Boshui Chen, Huiping Liu, Shaolei ZhangRL for Code GenerationAutomated Software Testing

  24. AI-Based Thesis Assessment: An Empirical Study of Human Evaluation Priorities and Their Impact on Automated Assessment

    Aug 1, 2026Garv Vikram Gursahaney, Baskhad Idrisov, Thorsten Fröhlich +1Rubric-Based EvaluationAutomated Grading

  25. The Theoretical Foundation of Socratic Tests: Dynamic, Multimodal, Conversational Examinations

    Jul 31, 2026Ilya MikhelsonEducational AssessmentMulti-Turn Dialogue Evaluation