cs.AINov 13, 2026

AI-aided Decision-Making in Education - Uncertainty, Explainability, and Human Responsibility

Authors: Fabian Kieser, Paul Tschisgale, Peter Wulff

Organizations: Physics and Physics Education Research, Ludwigsburg University of Education, Ludwigsburg, Germany · Department of Physics Education, Leibniz Institute for Science and Mathematics Education, Kiel, Germany

Abstract

As Artificial Intelligence (AI)-based systems have become increasingly integrated into various aspects of everyday life, including education, understanding how these systems make decisions is of paramount importance. AI holds significant potential to enhance educational practices through the facilitation of personalized and adaptive learning, automation of assessment procedures, and assistance with administrative tasks. However, the opacity of AI-based decision-making in education (especially with deep learning and generative AI models) can hamper decision-making, especially when outcomes appear unjustified or incorrect. In this chapter, we argue that three key principles (uncertainty, explainability, and human responsibility) are essential for the legitimate use of AI in educational settings. Acknowledging the inherent uncertainties in AI-based decisions, analogous to those in human decision-making, is fundamental. Explainability is critical for ensuring that the functioning and outcomes of AI applications are transparent and comprehensible to both educators and learners. Furthermore, human responsibility is crucial, particularly in human decision-making, which remains indispensable across all stages of AI development and deployment. By examining these three principles, this chapter provides a comprehensive guide for stakeholders seeking to integrate AI thoughtfully and effectively into the educational system.

Explore similar work

CardsList
  1. Addressing the Reality Gap: A Three-Tension Framework for Agentic AI Adoption

    Apr 29, 2026Jason Fournier, Kacper ŁodzikowskiAI in EducationGenerative AI in Education

  2. Rethinking Generative AI Literacy: An Integrative, Developmental, and Dialectical Framework for K-12 Teacher Education

    Aug 3, 2026Shahin Hossain, Sima Ahmadi, Leqi Li +7AI in EducationAI Literacy

  3. Relational AI in Education: Reciprocity, Participatory Design, and Indigenous Worldviews

    Apr 21, 2026Roberto Martinez-Maldonado, Vanessa Echeverria, Jenna Hawes +5AI in EducationGenerative AI in Education