Overview

Automated essay scoring studies how to assign reliable scores to essays and written responses, often by matching model judgments to human ratings and rubric criteria. Approaches range from linguistic-feature models and fine-tuned encoders to prompted large language models, with methods such as trait-based scoring, ordinal prediction, retrieval of scored examples, and rubric-guided feedback. Researchers test performance on benchmarks such as ASAP and TOEFL essays, while probing transfer across prompts, languages, scoring traits, and assessment settings. A central challenge is that strong average agreement does not ensure valid, stable, or fair scores: models can vary with wording, rubric, institution, and writer background, so careful validation and human oversight remain important.

Latest papers

CardsList

56 papers4 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Towards Robust Argumentative Essay Understanding via TIDE: An Interactive Framework with Trial and Debate

    May 17, 2026Zheqin Yin, Yupei Ren, Yadong Zhang +2Argument MiningAutomated Essay Scoring

  2. Counterargument for Critical Thinking as Judged by AI and Humans

    May 6, 2026Tosin Adewumi, Marcus Liwicki, Foteini Simistira Liwicki +3LLM-as-a-JudgeEducational Assessment

  3. Towards Self-Referential Analytic Assessment: A Profile-Based Approach to L2 Writing Evaluation with LLMs

    May 5, 2026Stefano Bannò, Kate Knill, Mark GalesLLM EvaluationAutomated Essay Scoring

  4. Automatic Reflection Level Classification in Hungarian Student Essays

    May 4, 2026Zsolt Csibi, Mónika Sándor, Mónika Serfőző +2Automated Essay ScoringLow-Resource Language Processing

  5. Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring

    May 3, 2026İbrahim Rıza Hallaç, Hasan OğulPairwise Preference LearningPairwise Comparison

  6. REC-CBM: Rubric-Aware Error-Correction Concept Bottleneck Models for Trustworthy Open-Ended Grading

    Apr 24, 2026Chengshuai Zhao, Fan Zhang, Kumar Satvik Chaudhary +4Concept Bottleneck ModelsAutomated Essay Scoring

  7. MAPLE: A Meta-learning Framework for Cross-Prompt Essay Scoring

    Apr 19, 2026Salam Albatarni, May Bashendy, Sohaila Eltanbouly +1Meta-LearningAutomated Essay Scoring

  8. Designing Reliable LLM-Assisted Rubric Scoring for Constructed Responses: Evidence from Physics Exams

    Apr 14, 2026Xiuxiu Tang, G. Alex Ambrose, Ying ChengAutomated GradingRubric-Based Evaluation

  9. Automated Scoring of Arabic Text Using Large Language Models: A Literature Review

    Apr 10, 2026Khaoula Dahimi, Hadda Cherroun, Amel BelabbaciAutomated GradingAutomated Essay Scoring

  10. LLM Essay Scoring Under Holistic and Analytic Rubrics: Prompt Effects and Bias

    Mar 31, 2026Filip J. Kucia, Anirban Chakraborty, Anna WróblewskaAutomated Essay ScoringLanguage Model Bias Evaluation

  11. LLMs Do Not Grade Essays Like Humans

    Mar 24, 2026Jerin George Mathew, Sumayya Taher, Anindita Kundu +1Automated Essay ScoringLLM-as-a-Judge

  12. Structured Prompting for Arabic Essay Proficiency: A Trait-Centric Evaluation Approach

    Mar 20, 2026Salim Al Mandhari, Hieu Pham Dinh, Mo El-Haj +1Automated Essay ScoringPrompt Engineering

  13. Implicit Grading Bias in Large Language Models: How Writing Style Affects Automated Assessment Across Math, Programming, and Essay Tasks

    Mar 19, 2026Rudra Jadhav, Janhavi Danve, Sonalika ShawLanguage Model Bias EvaluationLinguistic Bias in Language Models

  14. LLM-as-a-judge validity is strongly task-dependent across physics assessment formats

    Mar 16, 2026Will Yeadon, Tom Hardy, Paul Mackay +1LLM-as-a-JudgeEducational Assessment

  15. From Prompting to Preference Optimization: A Comparative Study of LLM-based Automated Essay Scoring

    Mar 6, 2026Minh Hoang Nguyen, Vu Hoang Pham, Xuan Thanh Huynh +5Automated Essay ScoringLanguage Model Post-Training

  16. Evaluating Austrian A-Level German Essays with Large Language Models for Automated Essay Scoring

    Mar 6, 2026Jonas Kubesch, Lena Huber, Clemens HavasAutomated Essay ScoringEducational Assessment

  17. From Feature-Based Models to Generative AI: Validity Evidence for Constructed Response Scoring

    Mar 1, 2026Jodi M. Casabianca, Daniel F. McCaffrey, Matthew S. Johnson +2Automated Essay ScoringEducational Assessment

  18. Qayyem: A Real-time Platform for Scoring Proficiency of Arabic Essays

    Mar 1, 2026Hoor Elbahnasawi, Marwan Sayed, Sohaila Eltanbouly +2Automated Essay ScoringArabic NLP

  19. BRIDGE the Gap: Mitigating Bias Amplification in Automated Scoring of English Language Learners via Inter-group Data Augmentation

    Feb 27, 2026Yun Wang, Xuansheng Wu, Jingyuan Huang +3Educational AssessmentData Augmentation

  20. Mitigating Bias in Automated Essay Scoring for ESL Learners via Contrastive Learning

    Jan 23, 2026Kevin Fan, Eric YunContrastive LearningEducational Assessment

  21. Exposía: Teaching and Assessment of Academic Writing Skills for Research Project Proposals and Peer Feedback

    Jan 10, 2026Dennis Zyska, Alla Rozovskaya, Ilia Kuznetsov +1Educational AssessmentAutomated Essay Scoring