AI in Education

Follow this topic Ask about this topic

Momentum

14 papers in the last four weeks, up 27% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 172

All topics

Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptation
May 8, 2026Abigail Victoria Gurin Schleifer, Moriah Ariely, Beata Beigman Klebanov +2LLM Evaluation AI in Education
Weizmann Institute of Science, Rehovot, Israel · ETS, Princeton, USA
NSMQ Riddles: A Benchmark of Scientific and Mathematical Riddles for Quizzing Large Language Models
May 8, 2026George Boateng, Naafi Ibrahim, Samuel John +8Mathematical Reasoning Benchmarks LLM Evaluation
ETH Zurich, Switzerland · Kwame AI Inc., U.S. · Ashesi University, Ghana +1
Cognitive Agent Compilation for Explicit Problem Solver Modeling
May 7, 2026Hyeongdon Moon, Carolyn Rosé, John StamperCognitive Architectures for AI Agents Cognitive Modeling
Carnegie Mellon University, Pittsburgh PA 15213, USA
From Surface Learning to Deep Understanding: A Grounded AI Tutoring System for Moodle
May 7, 2026Anna Ostrowska, Michał Kukla, Gabriela Majstrak +4Intelligent Tutoring Systems AI in Education
Faculty of Mathematics and Information Sciences, Warsaw University of Technology, Warsaw, Poland
The Pedagogy of AI Mistakes: Fostering Higher-Order Thinking
May 6, 2026Hadi HosseiniAI in Education AI Literacy
Pennsylvania State University University Park, USA
Human-AI Co-Mentorship in Project-Based Learning: A Case Study in Financial Forecasting
May 6, 2026Freyaa Chawla, Ahan Chawla, Rishi Singh +2Educational Technology AI in Education
Archbishop Mitty High School, San Jose, CA · University of Notre Dame, Notre Dame, IN · Indian Institute of Management Bodh Gaya, Bodh Gaya, India
AI SciBrief as a Gateway to Research: A Framework for Onboarding Students into New Research Areas
May 6, 2026Andrei Lazarev, Dmitrii SedovEducational Technology AI in Education
Department of Control and Applied Mathematics Moscow Institute of Physics and Technology Moscow, Russia
Cognitive Twins: Investigating Personalized Thinking Model Building and Its Performance Enhancement with Human-in-the-Loop
May 6, 2026Wu-Yuin Hwang, Nur Alif Ilyasa, Muhammad Irfan Luthfi +1Cognitive Modeling AI in Education
1National Central University, Taoyuan, Taiwan · 2National Dong Hwa University, Hualien, Taiwan · 3Universitas Negeri Yogyakarta, Yogyakarta, Indonesia
Guidelines for Designing AI Technologies to Support Adult Learning
May 6, 2026Jennifer M. Reddig, Glen R. Smith, Sanaz Ahmadzadeh Siyahrood +16Educational Technology AI in Education
Georgia Institute of Technology · Vanderbilt University · Georgia State University +1
A Dialogue-Based Framework for Correcting Multimodal Errors in AI-Assisted STEM Education
May 5, 2026Akshay Syal, Lawrence Swaminathan Xavier Prince, Evin Gultepe +2Multimodal Robustness AI in Education
Benchmarking Local Language Models for Social Robots using Edge Devices
May 4, 2026Dorian Lamouille, Matevž B. Zorec, Farnaz Baksh +1LLM Evaluation On-Device Language Model Inference
University of Tartu Tartu, Estonia · Institute of Computer Science University of Tartu Tartu, Estonia · Institute of Technology University of Tartu Tartu, Estonia
AI Expert Twin: Capturing Expert Cognition for Human-Centred, Practice-Based Learning
May 2, 2026Annie Yuan, Xiaohua Chen, Kalina Yacef +1Computational Cognitive Modeling Cognitive Modeling
The University of Sydney, NSW 2006, Australia · Beijing Institute of Fashion Technology, No. 2 Yinghua Road, Chaoyang District, Beijing, China, 100029
AI-Integrated Learning Management System for Middle School: A Longitudinal Study of Learning Outcomes Through High School and Beyond
May 2, 2026Misan Paul Etchie, Taiwo OlutosinIntelligent Tutoring Systems AI in Education
Northern Arizona University, Flagstaff, AZ, USA
AI Adoption Among Teachers: Insights on Concerns, Support, Confidence, and Attitudes
May 1, 2026Vanessa B. Sibug, Maria Anna D. Cruz, Vicky P. Vital +6AI in Education
College of Education Pampanga State University Bacolor, Pampanga, Philippines · College of Hospitality and Tourism Management Pampanga State University City of San Fernando, Pampanga Philippines · College of Education Pampanga State University Mexico, Pampanga, Philippines +3
Sentiment Analysis of AI Adoption in Indonesian Higher Education Using Machine Learning and Transformer-Based Models
Apr 30, 2026Happy Syahrul Ramadhan, Ahmad Sahidin Akbar, Karin Yehezkiel Sinaga +3AI in Education Sentiment Analysis
Faculty of Science Sumatra Institute of Technology Lampung, Indonesia · Faculty of Science Institut Teknologi Sumatera Lampung Selatan, Indonesia · Faculty of Industrial Technology Sumatra Institute of Technology Lampung, Indonesia
Exploring the Adoption Intention in Using AI-Enabled Educational Tools Among Preservice Teachers in the Philippines: A Partial-Least Square Modeling
Apr 30, 2026Vanessa B. Sibug, Emerson Q. Fernando, Almer B. Gamboa +6Educational Technology AI in Education
College of Education · Pampanga State University · Bacolor, Pampanga, Philippines +4
Addressing the Reality Gap: A Three-Tension Framework for Agentic AI Adoption
Apr 29, 2026Jason Fournier, Kacper ŁodzikowskiAI in Education Generative AI in Education
Imagine Learning · Adam Mickiewicz University, Poznań, Poland · Adam Mickiewicz University in Poznań
Unpacking Vibe Coding: Help-Seeking Processes in Student-AI Interactions While Programming
Apr 29, 2026Daiana Rinja, Eduardo Araujo Oliveira, Sonsoles López-Pernas +3AI in Education Programming Education
CATALPA, FernUniversität in Hagen, 58097 Hagen, Germany · School of Computing and Information Systems, University of Melbourne, Parkville VIC 3010, Australia · School of Computing, University of Eastern Finland, 80110 Joensuu, Finland
Ceci n'est pas une explication: Evaluating Explanation Failures as Explainability Pitfalls in Language Learning Systems
Apr 28, 2026Ben Knight, Wm. Matthew Kennedy, Danielle Carvalho +2Explainable Artificial Intelligence AI in Education
Oxford University Press, UK · Oxford Internet Institute University of Oxford, UK
The Nonverbal Syntax Framework: An Evidence-Based Tiered System for Inferring Learner States from Observable Behavioral Cues
Apr 28, 2026Sherzod Turaev, Mary John, Jaloliddin Rustamov +4AI in Education Affective Computing
Department of Computer Science & Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, Abu Dhabi, United Arab Emirates · Academic Support Department, Abu Dhabi Polytechnic, Abu Dhabi, United Arab Emirates · Department of Information Systems and Security, College of Information Technology, College of Information Technology, United Arab Emirates University, Al Ain, Abu Dhabi, United Arab Emirates
SciEval: A Benchmark for Automatic Evaluation of K-12 Science Instructional Materials
Apr 28, 2026Zhaohui Li, Peng He, Zhiyuan Chen +4LLM Evaluation AI in Education
Department of Computer Science and Engineering, University at Buffalo, USA · Department of Teaching and Learning, Washington State University, USA · College of Chemistry, Beijing Normal University, China +1
Co-Writing with AI: An Empirical Study of Diverse Academic Writing Workflows
Apr 28, 2026Silvia Bodei, Duncan P. Brumby, Katie Fisher +1AI in Education AI Literacy
University College London, London, United Kingdom
Beyond Tool Adoption: A Practical Five-Stage Developmental Continuum for AI Literacy in Higher Education
Apr 28, 2026J. Paul Liu, Rachel LevyAI in Education AI Literacy
1. Dept of Marine, Earth, and Atmospheric Sciences; 2. AI Hub for Science; 3. Center of Geospatial Analytics; 4. Data Science and AI Academy; 5. Department of Mathematics North Carolina State University
Barriers and Enablers of Online Instruction in Hospitality Education in the Philippines: An Exploratory Study
Apr 27, 2026Maria Anna D. Cruz, Jeaneth D. Serna, Lloyd D. Feliciano +5Educational Technology AI in Education
Pampanga State University, Pampanga, Philippines
Reheat Nachos for Dinner? Evaluating AI Support for Cross-Cultural Communication of Neologisms
Apr 26, 2026Dayeon Ki, Yu Hou, Rachel Rudinger +3AI in Education Human-AI Interaction
University of Maryland
Applications of the Transformer Architecture in AI-Assisted English Reading Comprehension
Apr 26, 2026Ping LiTransformer Interpretability Social Bias in Language Models
a Shandong Management University, Jinan, Shandong Province, 250357, China
Your Students Don't Use LLMs Like You Wish They Did
Apr 26, 2026Sebastian Kobler, Matthew Clemson, Angela Sun +1Educational Assessment AI in Education
The University of Sydney
ArguAgent: AI-Supported Real-Time Grouping for Productive Argumentation in STEM Classrooms
Apr 25, 2026Jennifer Kleiman, Yizhu Gao, Xin Xia +4AI in Education Generative AI in Education
AI4STEM Education Center, University of Georgia, Athens, GA, USA
Tell Me Why: Designing an Explainable LLM-based Dialogue System for Student Problem Behavior Diagnosis
Apr 24, 2026Zhilin Fan, Deliang Wang, Penghe Chen +1Explainable Artificial Intelligence AI in Education
School of Educational Technology, Beijing Normal University, Beijing, China · Faculty of Education, The University of Hong Kong, Hong Kong SAR, China · Advanced Innovation Center for Future Education, Beijing Normal University, Beijing, China
Locating acts of mechanistic reasoning in student team conversations with mechanistic machine learning
Apr 23, 2026Kaitlin Gili, Mainak Nistala, Kristen Wendell +1AI in Education Interpretable ML
Department of Computer Science, Tufts University, Medford, MA, U.S.A. · Departments of Mechanical Engineering and Education, Tufts University, Medford, MA, U.S.A.

May 8, 2026, cs.CLJ/K move · Enter open · S save

Quality-Conditioned Agreement in Automated Short Answer Scoring: Mid-Range Degradation and the Impact of Task-Specific Adaptation

Abigail Victoria Gurin Schleifer, Moriah Ariely, Beata Beigman Klebanov, Asaf Salman+1

Weizmann Institute of Science, Rehovot, Israel · ETS, Princeton, USA

LLM Evaluation AI in Education Few-Shot Learning Automated Grading

Open paper AskPDF arXiv

Automated short answer scoring (ASAS) is shifting from discriminative, fine-tuned models to large language models (LLMs) used in few-shot settings. This paradigm leverages LLMs broad world knowledge and ease of deployment, but limited task-specific data may reduce alignment on complex scoring tasks. In particular, its impact on scoring partially correct responses that require nuanced interpretation remains underexplored. We investigate the relationship between the degree of task-specific adaptation of different models and quality-conditioned scoring agreement. We compare three LLMs (GPT-5.2, GPT-4o, Claude Opus 4.5) in few-shot mode, a fine-tuned BERT-based encoder, and a human expert on two open-ended biology items, using several hundred student responses and ground truth scores provided by a biology education expert. The results show that human-human agreement is highest and stable across the full quality spectrum. All AI models perform well on fully correct and fully incorrect responses, but exhibit substantial degradation on mid-range responses. This mid-range degradation is conditioned on task-specific adaptation: It is most severe in few-shot LLMs with few examples and decreases as task-specific data increases, with fine-tuned encoder models performing best. This mid-range degradation may lead to inequitable evaluation of responses produced by students with developing understanding. Our findings highlight the importance of quality-conditioned fairness, with particular attention to mid-range responses.

Momentum

Related topics

Latest papers 172