Automated Grading

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 57

All topics

Leveraging BART to Assess CS1 C++ Programming Assignments using Rubric-based Criteria
Jun 2, 2026Kelsey Rainey, Jesse RobertsComputer Science Education Multi-Task Learning
Department of Computer Science Tennessee Technological University Cookeville, TN
"Important You should give me full credits!": Exploring Prompt Injection Attacks on LLM-Based Automatic Grading Systems
Jun 2, 2026Hang Li, Fedor Filippov, Yuping Lin +6Generative AI in Education LLM Security
Michigan State University
LLMs as Teaching Assistants for Mathematics Exam Grading: Reliability, and Practical Usability
Jun 1, 2026Aastha Sapkota, M. G. Sarwar MurshedLLM Evaluation LLM-as-a-Judge
Computer Science Department University of Wisconsin - Green Bay, Green Bay, WI, USA
Cost-Effective Automated Judging of Natural-Language Mathematical Proofs
May 29, 2026Benjamin GrayzelLLM-as-a-Judge Automated Grading
Department of Computer Science, Dartmouth College, Hanover, NH, USA.
From Kellgren-Lawrence to Calcium Pyrophosphate Crystal Deposition: A Soft-Labelling Framework for Knee Osteoarthritis Assessmen
May 27, 2026Francisco Bérchez-Moreno, Riccardo Rosati, Maria Chiara Fiorentino +6Label Distribution Learning Medical Image Classification
Departamento de Ciencia de la Computación e Inteligencia Artificial, Universidad de Córdoba, Córdoba, España · Department of Political Science, Communication, and International Relations, University of Macerata, Macerata, Italy · Department of Innovative Technologies in Medicine & Dentistry, Università degli Studi "G. D’Annunzio" Chieti - Pescara, Chieti, Italy +5
Machine learning applied to emerald gemstone grading: framework proposal and creation of a public dataset
May 22, 2026FB Pena, D Crabi, Sandro C Izidoro +2Automated Grading Image Classification
Laboratory of Robotics, Intelligent and Complex Systems (RobSIC) - Institutc of Science and Technology, Universidade Federal de Itajubd (UNIFED), Itabira, State of Minas Gerais, Brazil · Department of Academic Informatics (DAINF), Universidade Tecnológica Federal do Paraná (UTFPR), Pato Branco, State of Parana, Brazil
Exploring the Effectiveness of Using LLMs for Automated Assessment of Student Self Explanations in Programming Education
May 20, 2026Arun-Balajiee Lekshmi-Narayanan, Mohammad Hassany, Peter BrusilovskyLLM-as-a-Judge Programming Education
University of Pittsburgh
GradeLegal: Automated Grading for German Legal Cases
May 20, 2026Abdullah Al Zubaer, Lorenz Wendlinger, Simon Alexander Nonn +2LLM Evaluation Automated Grading
University of Passau Passau, Germany · Deggendorf Institute of Technology Deggendorf, Germany
Generative-Evaluative Agreement: A Necessary Validity Criterion for LLM-Enabled Adaptive Assessment
May 19, 2026Grandee Lee, Yue Wang, Che Yee Lye +1LLM Evaluation Educational Assessment
Singapore University of Social Sciences
Automated Grading of Handwritten Mathematics Using Vision-Capable LLMs
May 18, 2026Jacob Levine, Miguel Aenlle, Craig Zilles +2VLM Evaluation Rubric-Based Evaluation
University of Illinois Urbana-Champaign
RETUYT-INCO at BEA 2026 Shared Task 2: Meta-prompting in Rubric-based Scoring for German
May 11, 2026Ignacio Sastre, Ignacio Remersaro, Facundo Díaz +4LLM Prompting Rubric-Based Evaluation
Instituto de Computación, Facultad de Ingeniería, Universidad de la República Montevideo, Uruguay
High Precision Hydraulic Excavator Control for Heavy-Duty Grading
May 10, 2026Lennart Werner, Pol Eyschen, Sean Costello +2Robotic Control Robotics
ETH Zürich, Robotic Systems Lab, Zürich, Switzerland · Hexagon AB, Heerbrugg, Switzerland
Creating and Evaluating K-12 GenAI Assessment Graders Through Context Engineering
May 8, 2026Zewei Tian, Alex Liu, Lief Esbenshade +6Educational Assessment Generative AI in Education
University of Washington · Colleague AI
Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptation
May 8, 2026Abigail Victoria Gurin Schleifer, Moriah Ariely, Beata Beigman Klebanov +2LLM Evaluation AI in Education
Weizmann Institute of Science, Rehovot, Israel · ETS, Princeton, USA
LaTA: A Drop-in, FERPA-Compliant Local-LLM Autograder for Upper-Division STEM Coursework
May 6, 2026Jesse A. RodríguezLLM-as-a-Judge Generative AI in Education
School of Mechanical, Industrial, and Manufacturing Engineering Oregon State University Corvallis, OR 97331, USA
AISSA: Implementation and Deployment of an AI-based Student Slides Analysis tool for Academic Presentations
May 6, 2026Alvaro Becerra, Diego Gomez, Ruth CobosGenerative AI in Education Automated Grading
GHIA Group, School of Engineering, Universidad Autónoma de Madrid, Spain
Learning Coarse-to-Fine Osteoarthritis Representations under Noisy Hierarchical Labels
May 1, 2026Tongxu ZhangHierarchical Classification Hierarchical Representation Learning
The Hong Kong Polytechnic University
Estimating LLM Grading Ability and Response Difficulty in Automatic Short Answer Grading via Item Response Theory
Apr 30, 2026Longwei Cong, Sonja Hahn, Sebastian Gombert +3LLM Evaluation Automated Grading
DIPF | Leibniz Institute for Research and Information in Education · Faculty of Computer Science, Goethe University Frankfurt · 3Chemnitz University of Technology
Confidence Estimation in Automatic Short Answer Grading with LLMs
Apr 30, 2026Longwei Cong, Sonja Hahn, Sebastian Gombert +3Uncertainty Quantification Selective Prediction
DIPF | Leibniz Institute for Research and Information in Education, 60323 Frankfurt am Main, Germany · Faculty of Computer Science, Goethe University Frankfurt, 60629 Frankfurt am Main, Germany · Chemnitz University of Technology, 09111 Chemnitz, Germany
Human-in-the-Loop Benchmarking of Heterogeneous LLMs for Automated Competency Assessment in Secondary Level Mathematics
Apr 29, 2026Jatin Bhusal, Nancy Mahatha, Aayush Acharya +1LLM Evaluation Educational Assessment
Research and Incubation Center (RAIN), Sunway College Kathmandu
Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis
Apr 25, 2026Azmul A. Irfan, Nur Ahmad Khatim, Alfan Alfian Irfan +3Explainable Medical Image Analysis Automated Grading
Orthopaedic Department, Faculty of Medicine UIN Syarif Hidayatullah Jakarta, Indonesia · Informatics Engineering, Institut Teknologi Sepuluh Nopember, Indonesia · Information Technology, Universitas Muhammadiyah Yogyakarta, Indonesia +1
REC-CBM: Rubric-Aware Error-Correction Concept Bottleneck Models for Trustworthy Open-Ended Grading
Apr 24, 2026Chengshuai Zhao, Fan Zhang, Kumar Satvik Chaudhary +4Concept Bottleneck Models Automated Essay Scoring
School of Computing and Augmented Intelligence, Arizona State University, USA · Mary Lou Fulton Teachers College, Arizona State University, USA · Department of Computer Science, National Yang Ming Chiao Tung University, TW
Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges
Apr 21, 2026Ali Al-Kaswan, Maksim Plotnikov, Maxim Hájek +3LLM Agent Evaluation AI Agent Security Benchmarks
Delft University of Technology Delft, The Netherlands
From Scoring to Explanations: Evaluating SHAP and LLM Rationales for Rubric-based Teaching Quality Assessment
Apr 18, 2026Ivo Bueno, Babette Bühler, Philipp Stark +5Educational Assessment Shapley Value Attribution
1Technical University of Munich · 2Munich Center for Machine Learning (MCML) · 3Lund University +3
Persona Matters: Effects of Activation Steering on Short Answer Generation and Scoring
Apr 8, 2026Yongchao Wu, Aron HenrikssonOpen-Ended Generation Language Model Steering
Stockholm University, NOD-huset, Borgarfjordsgatan 12, 16455 Stockholm, Sweden
LLM-as-a-judge validity in physics assessment depends more on the task than the model
Mar 16, 2026Will Yeadon, Tom Hardy, Paul Mackay +1LLM-as-a-Judge Educational Assessment
Department of Physics, Durham University, Durham DH1 3LE, UK
QEDBENCH: Quantifying the Alignment Gap in Automated Evaluation of University-Level Mathematical Proofs
Feb 24, 2026Santiago Gonzalez, Alireza Amiri Bavandpour, Peter Ye +48Mathematical Reasoning Benchmarks LLM Evaluation

Jun 2, 2026, cs.AIJ/K move · Enter open · S save

Leveraging BART to Assess CS1 C++ Programming Assignments using Rubric-based Criteria

Kelsey Rainey, Jesse Roberts

Department of Computer Science Tennessee Technological University Cookeville, TN

Computer Science Education Multi-Task Learning Rubric-Based Evaluation Automated Grading

Open paper AskPDF arXiv

This paper investigates rubric-aware, multitask fine-tuning of transformer models for automated grading of introductory C++ programming assignments, with the goal of producing grade predictions that better reflect instructor grading behavior than general-purpose LLMs. Using multi-semester CS1 data, student submissions are paired with numeric scores, letter-grade buckets, and assignment rubrics, then preprocessed into unified sequences for transformer input. A BART encoder-decoder with LoRA adaptation is trained to jointly predict numeric grades and grade buckets, augmented with a distribution-matching term to align predicted and empirical grade distributions, an evaluation dimension often overlooked in prior work. Experiments compare single-task and multitask training, hard one-hot versus fuzzy and boundary-based soft labels, and rubric versus no-rubric conditions, with additional T5 and pairwise-pretrained variants. Results show that multitask BART with boundary-based soft labels and rubric context achieves lower mean absolute error and stronger grade-distribution alignment than single-task, hard-label, or code-only baselines. Fully fine-tuned T5 further improves distributional fidelity, while pairwise pretraining reduces numeric error at the cost of minority-class sensitivity. Collectively, the findings suggest that calibration-aware, rubric-guided training produces more instructor-like grading behavior than accuracy-optimized alternatives.

Momentum

Related topics

Latest papers 57