Grading

Ask about this topic

Momentum

6 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 59

All topics
CardsList

  1. Better Deck or Different Judge? Evaluating Agentic Harness Gains in Corporate and Investment Banking

    Sep 30, 2026Ludovic Gibert, Matis Despujols, Andre-Louis RochetGradingLarge Language Model Judges

    AIData2Action · TW3 Partners

  2. Multi-task learning for the automatic grading of enlarged perivascular space burden using MRI

    Sep 29, 2026Jesse Phitidis, William N. Whiteley, Joanna M. Wardlaw +11Vessel SegmentationMagnetic Resonance Imaging

    Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK · Canon Medical Research Europe, Edinburgh, UK · UK Dementia Research Institute, Centre at The University of Edinburgh, Edinburgh, UK +5

  3. Where LLM Graders Succeed and Break: Evidence from Two Computer-Science Exams

    Sep 24, 2026Ali Habibullah, Yazan Alshoibi, Mohammad Alshiekh +2GradingComputer Vision

    KAUST Academy Computer, Electrical & Mathematical Sciences & Engineering (CEMSE) King Abdullah University of Science and Technology (KAUST) Thuwal, Saudi Arabia · Visual Artificial Intelligence Laboratory Oxford Brookes University · KAUST Academy & CEMSE, KAUST +1

  4. How Good Are Frontier Models at Physics? Expert Re-Grading Reveals Broken Evaluations and Near-Saturation of Leading Benchmarks

    Sep 14, 2026Ali Ansari, Haoran Sun, Andy Zeyi Liu +48Frontier ModelsLarge Language Model Benchmarks

  5. Vision-Language Models for Criterion-Level Grading of Handwritten Examinations in Outcome-Based Education

    Sep 13, 2026Asif Hasan Tonmoy, Saad Ahmed, Md Khalid Syfullah +1GradingInter-Annotator Agreement

  6. GRADE: Single-Frame Generative Radar Depth Estimation Under Visual Degradation

    Sep 11, 2026Bin Zhao, Patrick Chiou, Nakul GargDepth EstimationRadar

    Rice University

  7. TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents

    Sep 4, 2026Zhibo Yang, Chen Zhang, Yuewei Zhang +1Artificial Intelligence ScientistsHuman-Annotated Benchmark

    TruthInsight-AI

  8. Jointly Predicting Courses and Grades Using a Transformer-Based Model

    Aug 13, 2026Paul SavalaForecasting BackboneSequence Modeling

    Mathematics, St. Edward’s University, 3001 S Congress Ave, Austin, 78704, TX, USA. · S Congress Ave

  9. Reproducing and Stress-Testing Two Approaches to LLM Reasoning Reliability: Test-Time Probability Aggregation and Logic-Representation Editing

    Aug 9, 2026Minhan Cho, Jimin KweonLLM Reasoning StrategiesValidation

    Remember & Company AI Lab · DSAIL, Dept. of Applied AI · Sungkyunkwan University +2

  10. WebGrader: Training LLMs for Web Development with Self-Evolving Programmatic Grader

    Aug 6, 2026Boshui Chen, Huiping Liu, Shaolei ZhangWebGrading

    Beijing Institute of Technology, China · Beijing Jiaotong University, China · Renmin University of China, China

  11. Bias Analysis of L2 Speaking Assessment Systems Using Concept Activation Vectors

    Aug 6, 2026Arya Labroo, Mengjie Qian, Kate KnillSpeakerLarge Language Model Bias

    University of Cambridge

  12. RADAR: Rubric-Aware Dependency and Redundancy Analysis for LLM-as-Judge Evaluation

    Aug 3, 2026Divyansh Singh, Reza Davari, Afra MashhadiLlm-As-A-JudgeGrading

    Microsoft · University of Florida · University of Washington

  13. The Theoretical Foundation of Socratic Tests: Dynamic, Multimodal, Conversational Examinations

    Jul 31, 2026Ilya MikhelsonComputerized Adaptive TestingSocratic Dialogue

    Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL, USA

  14. GAUGE: Grading Agent-Built Financial Models Without a Golden Answer

    Jul 27, 2026Jiacheng Lu, Sinuo Wang, Wentao Zhao +12Finance BenchmarksGrading

    Shanghai Jiao Tong University Shanghai, China · StepFun Shanghai, China · University of Adelaide Adelaide, Australia +5

  15. Hierarchical Grading in Large Language Models

    Jul 23, 2026T. ShaskaGradingInference Cost

  16. CrossSpine: Multi-scale Cross-sequence Attention with Anatomical Priors for Automated Pfirrmann Grading

    Jul 22, 2026Hai Son Nguyen, Duong Ngoc Vu, Trong-Nghia Nguyen +5Anatomical PriorsMulti-Scale Attention

    Business AI Lab, College of Technology, National Economics University, Vietnam · Medical Imaging & Radiological Technology Department, Faculty of Medical Technology, Phenikaa School of Medicine & Pharmacy, Phenikaa University, Vietnam · Radiology & Functional Exploration Center, Phenikaa University Hospital, Vietnam +2

  17. Measuring Reward-Seeking via Contrastive Belief Updates

    Jul 21, 2026Axel Højmark, Jérémy Scheurer, Evgenia Nitishinskaya +5Progress Reward ModelingReward Signal

    Apollo Research · OpenAI

  18. Evaluating Large Language Models on Misconceptions in Multi-Turn Medical Conversations

    Jul 14, 2026Monica Munnangi, Saiph SavageStudent MisconceptionsLarge Language Models Fail

    Khoury College of Computer Sciences Northeastern University

  19. Who Grades the Grader? Co-Evolving Evaluation Metrics and Skills for Self-Improving LLM Agents

    Jul 14, 2026Xing Zhang, Guanghui Wang, Yanwei Cui +4Agentic EvaluationsEvaluation Metrics

    1AWS Generative AI Innovation Center · 2HSBC Holdings Plc., HSBC Technology Center, China

  20. Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-Research Source Attribution

    Jul 9, 2026Ethan Leung, Elias Lumer, Corey Feld +3Large Language Model JudgesCitations

    Commercial Technology and Innovation Office, PricewaterhouseCoopers, U.S.

  21. Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning

    Jul 8, 2026Vladislav BeliaevReinforcement Learning With Verifiable RewardLarge Reasoning Models

    Independent Researcher

  22. Automated grading of Linux/bash examinations using large language models: a four-level cognitive taxonomy approach

    Jul 2, 2026Manuel Alonso-Carracedo, Ruben Fernandez-Boullon, Pedro Celard +2GradingAssessment

    aUniversidade de Vigo, Department of Computer Science, ESEI-Higher School of Computer Engineering, Edificio Politécnico, Campus Universitario As Lagoas s/n, Ourense, 32004, Spain · bIFCAE-Institute for Research in Physics, Computing and Aerospace Science, Universidade de Vigo, Ourense, 32004, Spain

  23. Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground Truth

    Jun 30, 2026Sajjad Abdoli, Ghassan Al-Sumaidaee, Ahmad ElShiekh +2Cultural AwarenessArabic

    1Perle AI

  24. SkillSpotter: Pose-Aware Multi-View Skilled Action Detection and Grading in Ego-Exo Videos

    Jun 30, 2026Björn Braun, Christian HolzTemporal Action LocalizationOpen-Vocabulary Action Recognition

    Department of Computer Science, ETH Zürich, Switzerland

  25. Clinical Risk-Aware Multi-Level Grading for Coronary Artery Stenosis through Curved Feature Reconstruction

    Jun 29, 2026Shishuang Zhao, Hongtai Li, Junjie Hou +1Geometric ReconstructionCurves

    Yizhun Medical AI Co., Ltd · The First Hospital of China Medical University

  26. The strength of clinical evidence is recoverable from language model representations but not from their stated grades

    Jun 27, 2026Soroosh Tayebi ArastehLarge Language Model ReliabilityEvidence Conflict

    Lab for AI in Medicine, RWTH Aachen University, Aachen, Germany · Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen · Department of Urology, Stanford University, Stanford, CA, USA +1

  27. Grading the Grader: Lessons from Evaluating an Agentic Data Analysis System

    Jun 23, 2026Tian Zheng, Kai-Tai HsuGradingData Science Agents

    Department of Statistics Columbia University New York, NY

  28. LLM Performance on a Real, Double-Marked GCSE Benchmark

    Jun 23, 2026Malachy Fox, Kavi Samra, Paul JungGradingAssessment

    Medly AI

  29. GRADE: Graph Representation of LLM Agent Dependency and Execution

    Jun 22, 2026Yue ZhaoLarge Language Model AgentsGraph Representations

    University of Southern California

  30. Intelligence Is Not the Bottleneck: Validating an LLM First-Pass Manuscript Score Against Peer-Review Outcomes

    Jun 14, 2026Costa GeorgantasPeer ReviewReview

  31. Semantic Grading of Written Answers in Low-Resource Language Bangla Using a Fine-Tuned Lightweight Language Model

    Jun 10, 2026Meherun Farzana, Aniket Joarder, Mahmudul Hasan +1BanglaGrading

    Computer Science and Engineering, University of Dhaka

  32. Towards Fully Automated Exam Grading: Fairness-Aware Recognition of Handwritten Answers with Foundation Models

    Jun 9, 2026Hartwig GrabowskiGradingHandwriting

    Institute for Machine Learning and Analytics (IMLA), Offenburg University, Offenburg, Germany.

  33. A Finetuned SpeechLLM for Joint Multi-Granular L2 Assessment and Natural-Language Rationales

    Jun 8, 2026Aditya Kamlesh Parikh, Cristian Tejedor-Garcia, Catia Cucchiarini +1Speech Language ModelsProficiency

    Centre for Language Studies, Radboud University, Nijmegen, The Netherlands

  34. Hybrid E-Assessment in Higher Education: Semi-Automated Grading of Paper-Based Written Examinations

    Jun 7, 2026Hartwig Grabowski, Michael CanzComputerized Adaptive TestingAssessment

    Institute for Machine Learning and Analytics, Hochschule Offenburg, Offenburg, Germany. · Hochschule Offenburg, Offenburg, Germany.

  35. Impacts of Histories and Models on LLM Grading: A Study in Advanced Software Engineering Courses

    Jun 7, 2026Qilin Zhou, Zhuo Wang, Yue Li +1GradingSoftware Engineering

    City University of Hong Kong, Hong Kong SAR, China

  36. EDIT: Evidence-Diagnosed Intervention Training for Rule-Faithful LLM Grading

    Jun 4, 2026Zhihao Wu, Linhai Zhang, Taiyi Wang +4Grading

    1King’s College London · University of Cambridge · 3AQA +1

  37. "Important You should give me full credits!": Exploring Prompt Injection Attacks on LLM-Based Automatic Grading Systems

    Jun 2, 2026Hang Li, Fedor Filippov, Yuping Lin +6GradingIndirect Prompt Injection

    Michigan State University

  38. LLMs as Teaching Assistants for Mathematics Exam Grading: Reliability, and Practical Usability

    Jun 1, 2026Aastha Sapkota, M. G. Sarwar MurshedGradingPreliminary Study

    Computer Science Department University of Wisconsin - Green Bay, Green Bay, WI, USA

  39. BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law

    May 27, 2026Sebastian Nagl, Ann-Kristin Mayrhofer, Martin Heidebach +6Legal Reasoning TasksGerman

    Technical University of Munich (TUM) · Ludwig Maximilian University of Munich (LMU) · University of Konstanz +1

  40. From Kellgren-Lawrence to Calcium Pyrophosphate Crystal Deposition: A Soft-Labelling Framework for Knee Osteoarthritis Assessmen

    May 27, 2026Francisco Bérchez-Moreno, Riccardo Rosati, Maria Chiara Fiorentino +6SeverityChronic Kidney Disease

    Departamento de Ciencia de la Computación e Inteligencia Artificial, Universidad de Córdoba, Córdoba, España · Department of Political Science, Communication, and International Relations, University of Macerata, Macerata, Italy · Department of Innovative Technologies in Medicine & Dentistry, Università degli Studi "G. D’Annunzio" Chieti - Pescara, Chieti, Italy +5

  41. GRADE: Generalizable Reasoning-Aware Dialogue Evaluation for AI Tutors

    May 27, 2026Parth Bhalerao, Jeromy Chang, David Chou +1TutorsGrading

    Santa Clara University

  42. Machine learning applied to emerald gemstone grading: framework proposal and creation of a public dataset

    May 22, 2026FB Pena, D Crabi, Sandro C Izidoro +2Silver BulletGrading

    Laboratory of Robotics, Intelligent and Complex Systems (RobSIC) - Institutc of Science and Technology, Universidade Federal de Itajubd (UNIFED), Itabira, State of Minas Gerais, Brazil · Department of Academic Informatics (DAINF), Universidade Tecnológica Federal do Paraná (UTFPR), Pato Branco, State of Parana, Brazil

  43. MARGIN: Runtime Confidence Calibration for Multi-Agent Foundation Model Coordination

    May 21, 2026Joss ArmstrongWireless Foundation ModelsFoundation Model

    Ericsson, Athlone, Ireland

  44. GradeLegal: Automated Grading for German Legal Cases

    May 20, 2026Abdullah Al Zubaer, Lorenz Wendlinger, Simon Alexander Nonn +2GradingLegal Reasoning Tasks

    University of Passau Passau, Germany · Deggendorf Institute of Technology Deggendorf, Germany

  45. LP-Eval: Rubric and Dataset for Measuring the Quality of Legal Proposition Generation

    May 19, 2026Shanshan Xu, Johan Lindholm, Amogh Raina +2Legal Reasoning TasksLegal Domain

    University of Copenhagen · Umeå University

  46. Automated Grading of Handwritten Mathematics Using Vision-Capable LLMs

    May 18, 2026Jacob Levine, Miguel Aenlle, Craig Zilles +2GradingHandwriting

    University of Illinois Urbana-Champaign

  47. High Precision Hydraulic Excavator Control for Heavy-Duty Grading

    May 10, 2026Lennart Werner, Pol Eyschen, Sean Costello +2Control ArchitecturePrecision

    ETH Zürich, Robotic Systems Lab, Zürich, Switzerland · Hexagon AB, Heerbrugg, Switzerland

  48. Creating and Evaluating K-12 GenAI Assessment Graders Through Context Engineering

    May 8, 2026Zewei Tian, Alex Liu, Lief Esbenshade +6GradingGenerative Artificial Intelligence

    University of Washington · Colleague AI

  49. LaTA: A Drop-in, FERPA-Compliant Local-LLM Autograder for Upper-Division STEM Coursework

    May 6, 2026Jesse A. RodríguezGradingModifications

    School of Mechanical, Industrial, and Manufacturing Engineering Oregon State University Corvallis, OR 97331, USA

  50. Terminus-4B: Can a Smaller Model Replace Frontier LLMs at Agentic Execution Tasks?

    May 4, 2026Spandan Garg, Vikram Nitin, Yufan HuangGrading

    Microsoft USA

  51. Estimating LLM Grading Ability and Response Difficulty in Automatic Short Answer Grading via Item Response Theory

    Apr 30, 2026Longwei Cong, Sonja Hahn, Sebastian Gombert +3GradingItem Response Theory

    DIPF | Leibniz Institute for Research and Information in Education · Faculty of Computer Science, Goethe University Frankfurt · 3Chemnitz University of Technology

  52. Confidence Estimation in Automatic Short Answer Grading with LLMs

    Apr 30, 2026Longwei Cong, Sonja Hahn, Sebastian Gombert +3GradingConfidence Estimation

    DIPF | Leibniz Institute for Research and Information in Education, 60323 Frankfurt am Main, Germany · Faculty of Computer Science, Goethe University Frankfurt, 60629 Frankfurt am Main, Germany · Chemnitz University of Technology, 09111 Chemnitz, Germany

  53. Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis

    Apr 25, 2026Azmul A. Irfan, Nur Ahmad Khatim, Alfan Alfian Irfan +3XaiDigitally Reconstructed Radiographs

    Orthopaedic Department, Faculty of Medicine UIN Syarif Hidayatullah Jakarta, Indonesia · Informatics Engineering, Institut Teknologi Sepuluh Nopember, Indonesia · Information Technology, Universitas Muhammadiyah Yogyakarta, Indonesia +1

  54. Controllable Spoken Dialogue Generation: An LLM-Driven Grading System for K-12 Non-Native English Learners

    Apr 24, 2026Haidong Yuan, Haokun Zhao, Wanshi Xu +4ProficiencyGrading

    Peking University · Fudan University · Tencent +2

  55. REC-CBM: Rubric-Aware Error-Correction Concept Bottleneck Models for Trustworthy Open-Ended Grading

    Apr 24, 2026Chengshuai Zhao, Fan Zhang, Kumar Satvik Chaudhary +4GradingConcept Bottleneck Models

    School of Computing and Augmented Intelligence, Arizona State University, USA · Mary Lou Fulton Teachers College, Arizona State University, USA · Department of Computer Science, National Yang Ming Chiao Tung University, TW

  56. GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

    Mar 12, 2026Mingxin Liu, Ziqian Fan, Zhaokai Wang +13Image EditingGrading

    Shanghai Jiao Tong University · South China University of Technology · Fudan University +2

  57. Am I More Pointwise or Pairwise? Revealing Position Bias in Rubric-Based LLM-as-a-Judge

    Feb 2, 2026Yuzheng Xu, Tosho Hirasawa, Tadashi Kozuno +1Llm-As-A-JudgeModel Judgments

    OMRON SINIC X · NexaScience

  58. Eval-Actions: Fine-Grained Execution Quality Evaluation for Robotic Manipulation

    Jan 26, 2026Mengyuan Liu, Juyi Sheng, Peiming Li +4Robotic ManipulationMultimodal Evaluation

  59. No Free Labels: Limitations of LLM-as-a-Judge Without Human Grounding

    Mar 7, 2025Michael Krumdick, Charles Lovering, Varshini Reddy +2Llm-As-A-JudgeGrading

    Kensho Technologies · MIT