Overview

Automated essay scoring studies how to assign reliable scores to essays and written responses, often by matching model judgments to human ratings and rubric criteria. Approaches range from linguistic-feature models and fine-tuned encoders to prompted large language models, with methods such as trait-based scoring, ordinal prediction, retrieval of scored examples, and rubric-guided feedback. Researchers test performance on benchmarks such as ASAP and TOEFL essays, while probing transfer across prompts, languages, scoring traits, and assessment settings. A central challenge is that strong average agreement does not ensure valid, stable, or fair scores: models can vary with wording, rubric, institution, and writer background, so careful validation and human oversight remain important.

Latest papers

CardsList

56 papers4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Inside the Scorer: Mechanistic Evidence on Rubric Control in LLM-Based Automated Essay Scoring from 25 Base Models

    Oct 19, 2026Chungche Huang, Po-Ya Angela Wang, Shu-Kai HsiehAutomated Essay ScoringRubric-Based Evaluation

  2. Machine--human agreement in marking undergraduate assignments is specific to model, prompt and institution

    Oct 13, 2026Giulio Corsi, Maryam Abo-Tabik, Yael Benn +4Automated GradingLLM-as-a-Judge

  3. TeachGrade: Training-Free Short Answer Scoring with Teacher Evidence

    Oct 10, 2026Jinhao Yan, Zhihong Shen, Shengjie Wang +4Automated GradingLLM-as-a-Judge

  4. Error-Supervised Synthetic Learner Writing for Automated Essay Scoring

    Sep 20, 2026Duy Anh NguyenAutomated Essay ScoringSynthetic Data Generation for Language Models

  5. The Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment

    Sep 15, 2026Donya Rooein, Luca Benedetto, Dirk HovyAI in EducationGenerative AI in Education

  6. Who Should Grade My Work? Student Perspectives on Transparent AI-Assisted Writing Assessment in Higher Education

    Sep 4, 2026Rayed AlGhamdiGenerative AI in EducationHuman Oversight of AI

  7. A Human-in-the-Loop Framework for AI-Assisted Scoring in Large-Scale Writing Assessment

    Sep 4, 2026María Eugenia Curi, Germán Capdehourat, Isabel Amigo +4Educational AssessmentAutomated Grading

  8. A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring

    Aug 28, 2026Shihang Yang, Sanwoo Lee, Ningning Zhao +1Automated Essay ScoringRubric-Guided Generation

  9. Comparative Validation of GPT-4o-mini and Teacher Mean Scores for Automated Scoring of Music Analysis Responses: Single-Pass Deployment, Repeatability, and Strategy-Specific Bias

    Aug 3, 2026Baicheng Lin, Lingxi Jin, Kyung-Seok MinLLM-as-a-JudgeEducational Technology

  10. ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring

    Jul 30, 2026Shengjie Li, Vincent NgAutomated Essay Scoring

  11. WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays

    Jul 16, 2026Adnan Labib, Yixuan Huang, Jiahui Wu +3Automated Essay Scoring

  12. When Rubrics Change: Cross-Rubric Generalization for Critical Thinking Essay Scoring

    Jul 15, 2026Nischal Ashok Kumar, Payu Wittawatolarn, Sana Kang +7Educational AssessmentAutomated Essay Scoring

  13. Demographic Metadata as Construct-Irrelevant Noise in DistilBERT-Based Automated Essay Scoring

    Jun 19, 2026Teik Peng Ch'ng, Hui Na ChuaAutomated Essay ScoringDemographic Bias in Language Models

  14. PsyScore: A Psychometrically-Aware Framework for Trait-Adaptive Essay Scoring and ZPD-Scaffolded Feedback

    Jun 18, 2026Wei Xia, Jin Wu, Haoran Shi +2Educational AssessmentAutomated Essay Scoring

  15. From Texts to Scores: Tracing the Emergence of Essay Quality Representations in Large Language Models

    Jun 18, 2026Jiaxu Zuo, Mu You, Kaixin Lan +5LLM InterpretabilityAutomated Essay Scoring

  16. Automated Essay Scoring and Language Certification: Assessing Generalizability, Agreement and Validity for French

    Jun 1, 2026Rodrigo Wilkens, Rémi Cardon, Vincent Folny +1Automated Essay Scoring

  17. Learnable Assessment Skills for LLM-based Automated Scoring: Rubric Construction via Iterative Optimization

    May 28, 2026Yun Wang, Xin Xia, Xuansheng Wu +2Automatic Rubric GenerationAutomated Essay Scoring

  18. Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring

    May 25, 2026Zhengyang Wang, Sanwoo Lee, Jiaxin Wang +3Automated Essay ScoringLanguage Model Post-Training

  19. A Two-Phase Stability Study of LLM Judges and Bar Council Examiners on Thai Bar-Exam Free-Form Essays

    May 25, 2026Pawitsapak Akarajaradwong, Wuttikrai Lertprasertphakorn, Chompakorn Chaksangchaichot +1Inter-Rater ReliabilityAnnotator Disagreement