Automated Grading

Ask about this topic

Overview

Automated grading studies how to assess student work consistently, from short answers and essays to mathematical reasoning, handwritten exams, and programming assignments. Approaches include fine-tuned language models and encoders, rubric-guided LLM judges, and vision-language systems that read handwritten work; many combine scores with explanations or route uncertain cases to human graders. Systems are commonly evaluated against expert marks using agreement and error measures, with benchmarks testing transfer across subjects, questions, and scoring rubrics. A central challenge is handling partial or ambiguous answers reliably while avoiding bias, prompt sensitivity, and overconfidence, so human oversight remains important, especially for high-stakes decisions.

Latest papers

CardsList

89 papers6 papers in the last four weeks, down 14% on the four weeks before. 0.0% of all new papers.

  1. Human-in-the-Loop Benchmarking of Heterogeneous LLMs for Automated Competency Assessment in Secondary Level Mathematics

    Apr 29, 2026Jatin Bhusal, Nancy Mahatha, Aayush Acharya +1LLM EvaluationEducational Assessment

    Research and Incubation Center (RAIN), Sunway College Kathmandu

  2. Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis

    Apr 25, 2026Azmul A. Irfan, Nur Ahmad Khatim, Alfan Alfian Irfan +3Explainable Medical Image AnalysisAutomated Grading

    Orthopaedic Department, Faculty of Medicine UIN Syarif Hidayatullah Jakarta, Indonesia · Informatics Engineering, Institut Teknologi Sepuluh Nopember, Indonesia · Information Technology, Universitas Muhammadiyah Yogyakarta, Indonesia +1

  3. REC-CBM: Rubric-Aware Error-Correction Concept Bottleneck Models for Trustworthy Open-Ended Grading

    Apr 24, 2026Chengshuai Zhao, Fan Zhang, Kumar Satvik Chaudhary +4Concept Bottleneck ModelsAutomated Essay Scoring

    School of Computing and Augmented Intelligence, Arizona State University, USA · Mary Lou Fulton Teachers College, Arizona State University, USA · Department of Computer Science, National Yang Ming Chiao Tung University, TW

  4. Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges

    Apr 21, 2026Ali Al-Kaswan, Maksim Plotnikov, Maxim Hájek +3LLM Agent EvaluationAI Agent Security Benchmarks

    Delft University of Technology Delft, The Netherlands

  5. From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment

    Apr 18, 2026Ivo Bueno, Babette Bühler, Philipp Stark +5Educational AssessmentShapley Value Attribution

    1Technical University of Munich · 2Munich Center for Machine Learning (MCML) · 3Lund University +3

  6. Multitasking Embedding for Embryo Blastocyst Grading Prediction (MEmEBG)

    Apr 14, 2026Nahid Khoshk Angabini, Mohsen Tajgardan, Mahesh Madhavan +3Automated GradingMicroscopy Image Analysis

    ⋆Department of Computer Science and Media Technology, Malmö University, Malmö, Sweden · ◦Faculty of Electrical and Computer Engineering, Qom University of Technology, Iran · †Kepler Universitätsklinikum, Linz, Austria

  7. Designing Reliable LLM-Assisted Rubric Scoring for Constructed Responses: Evidence from Physics Exams

    Apr 14, 2026Xiuxiu Tang, G. Alex Ambrose, Ying ChengAutomated GradingRubric-Based Evaluation

    Department of Psychology, University of Notre Dame, Notre Dame, IN, 46556, USA · Notre Dame Learning, University of Notre Dame, Notre Dame, IN, 46556, USA

  8. Automated Scoring of Arabic Text Using Large Language Models: A Literature Review

    Apr 10, 2026Khaoula Dahimi, Hadda Cherroun, Amel BelabbaciAutomated GradingAutomated Essay Scoring

    Laboratoire d’Informatique et de Mathématiques LIM Amar Telidji University, Laghouat, Algeria

  9. Chatbot-Based Assessment of Code Understanding in Automated Programming Assessment Systems

    Apr 8, 2026Eduard Frankford, Erik Cikalleshi, Ruth BreuEducational AssessmentAutomated Evaluation

    University of Innsbruck, Department of Computer Science, Innsbruck, Austria

  10. Persona Matters: Effects of Activation Steering on Short Answer Generation and Scoring

    Apr 8, 2026Yongchao Wu, Aron HenrikssonOpen-Ended GenerationLanguage Model Steering

    Stockholm University, NOD-huset, Borgarfjordsgatan 12, 16455 Stockholm, Sweden

  11. LumiVideo: An Intelligent Agentic System for Video Color Grading

    Apr 2, 2026Yuchen Guo, Junli Gong, Hongmin Cai +2Agentic Video EditingAutomated Grading

    Northwestern University, Evanston, USA · Northeastern University, Seattle, USA · South China University of Technology, Guangzhou, China +2

  12. A CEFR-Inspired Classification Framework with Fuzzy C-Means To Automate Assessment of Programming Skills in Scratch

    Apr 1, 2026Ricardo Hidalgo-Aragón, Jesús M. González-Barahona, Gregorio RoblesEducational AssessmentProgramming Education

    Universidad Rey Juan Carlos, Madrid, Spain

  13. When Can We Trust LLM Graders? Calibrating Confidence for Automated Assessment

    Mar 31, 2026Robinson Ferrer, Damla Turgut, Zhongzhou Chen +1Confidence Estimation in Language ModelsLanguage Model Calibration

    University of Central Florida

  14. Training data generation for context-dependent rubric-based short answer grading

    Mar 30, 2026Pavel Šindelář, Dávid Slivka, Christopher Bouma +2Synthetic Data GenerationAutomated Grading

    Faculty of Mathematics and Physics at Charles University

  15. Do Small Language Models Know When They're Wrong? Confidence-Based Cascade Scoring for Educational Assessment

    Mar 29, 2026Tyler BurleighLanguage Model CascadingAutomated Grading

    Khan Academy

  16. Self-Supervised Learning for Knee Osteoarthritis: Diagnostic Limitations and Prognostic Value of Hospital Data

    Mar 26, 2026Haresh Rengaraj Rajamohan, Yuxuan Chen, Kyunghyun Cho +1Self-Supervised LearningRadiology VLMs

    Center for Data Science, New York University, New York, 10011, NY, United States · Perlmutter Cancer Center, New York University Langone Health, New York, 10016, NY, USA · Department of Radiology, New York University Langone Health, New York, 10016, NY, USA +1

  17. Exploring Data Augmentation and Resampling Strategies for Transformer-Based Models to Address Class Imbalance in AI Scoring of Scientific Explanations in NGSS Classroom

    Mar 21, 2026Prudence Djagba, Kevin Haudek, Clare G. C. Franovic +1Science EducationAutomated Grading

    CREATE for STEM, Michigan State University, East Lansing, USA · Human Biology, Michigan State University, East Lansing, USA · University of Houston, Houston, USA

  18. Implicit Grading Bias in Large Language Models: How Writing Style Affects Automated Assessment Across Math, Programming, and Essay Tasks

    Mar 19, 2026Rudra Jadhav, Janhavi Danve, Sonalika ShawLanguage Model Bias EvaluationLinguistic Bias in Language Models

    Department of Computer Science, Savitribai Phule Pune University, Pune, India · Department of Computer Science, Dr. D. Y. Patil School of Science and Technology, Pune, India

  19. LLM-as-a-judge validity is strongly task-dependent across physics assessment formats

    Mar 16, 2026Will Yeadon, Tom Hardy, Paul Mackay +1LLM-as-a-JudgeEducational Assessment

    Department of Physics, Durham University, Durham DH1 3LE, UK

  20. Human-in-the-Loop LLM Grading for Handwritten Mathematics Assessments

    Mar 13, 2026Arne Vanhoyweghen, Vincent Holst, Melika Mobini +9Automated GradingAI in Education

    Data Analytics Lab, Vrije Universiteit Brussel, 1050 Brussel, Belgium · School of Engineering and Applied Sciences, Harvard University, Cambridge, Massachusetts 02138, USA

  21. CHiL(L)Grader: Calibrated Human-in-the-Loop Short-Answer Grading

    Mar 12, 2026Pranav Raikote, Korbinian Randl, Ioanna Miliou +2Automated GradingAI in Education

    Department of Computer and Systems Sciences, Stockholm University, 164 25 Kista, Sweden

  22. S-GRADES -- Studying Generalization of Student Response Assessments in Diverse Evaluative Settings

    Mar 10, 2026Tasfia Seuti, Sagnik Ray ChoudhuryAutomated GradingEducational Assessment

    University of North Texas, Denton, TX, USA

  23. Autoscoring Anticlimax: A Meta-analytic Understanding of AI's Short-answer Shortcomings and Wording Weaknesses

    Mar 5, 2026Michael HardyAutomated GradingAutomated Essay Scoring

    Stanford University

  24. Evaluating AI Grading on Real-World Handwritten College Mathematics: A Large-Scale Study Toward a Benchmark

    Mar 1, 2026Zhiqi Yu, Xingping Liu, Haobin Mao +4Automated GradingGenerative AI in Education

    UC Irvine Irvine, USA · Independent Shanghai, China · UC Berkeley Berkeley, USA

  25. Optimizing In-Context Demonstrations for LLM-based Automated Grading

    Feb 28, 2026Yucheng Chu, Hang Li, Kaiqi Yang +4EducationAutomated Grading

    Michigan State University · University of Southern California

  26. From Flat to Structural: Enhancing Automated Short Answer Grading with GraphRAG

    Feb 28, 2026Yucheng Chu, Haoyu Han, Shen Dong +6Automated GradingEducational Assessment

    Michigan State University · University of Southern California

  27. Confusion-Aware Rubric Optimization for LLM-based Automated Grading

    Feb 28, 2026Yucheng Chu, Hang Li, Kaiqi Yang +4Automated GradingPrompt Optimization

    Michigan State University · University of Southern California

  28. QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofs

    Feb 24, 2026Santiago Gonzalez, Alireza Amiri Bavandpour, Peter Ye +48Mathematical Reasoning BenchmarksLLM Evaluation

  29. How Uncertain Is the Grade? A Benchmark of Uncertainty Metrics for LLM-Based Automatic Assessment

    Feb 17, 2026Hang Li, Kaiqi Yang, Xianxuan Long +9Uncertainty QuantificationLLM Uncertainty Estimation

    Washington State University, Pullman, USA