cs.SENov 10, 2026

Outcome Over Learning? Evidence from Student Use of AI Code Assistants for Unit Test Writing

Authors: Daniel Hinbest, Jeremy S. Bradbury, Michael A. Miljanovic

Organizations: Ontario Tech University Oshawa, ON, Canada

Abstract

Artificial intelligence (AI) code assistants are rapidly being adopted in programming education, yet little is known about how students naturally use these tools when given unrestricted access. In a user study investigating AI-assisted unit test writing, we observed that a majority of students adopted a one-shot interaction strategy, asking the AI to generate a complete unit test directly from the initial requirements. While this approach is capable of efficiently producing a solution, it shifts students' focus from learning how to write effective unit tests to simply completing the task. Moreover, because students rarely engaged in critically evaluating, refining, or iterating on AI-generated output, they may be missing opportunities to develop the critical thinking skills that are essential for effective and responsible use of AI. In an effort to shift student focus from outcome to learning we also discuss how training, accountability and improved learning task design can better support a more learning-centric responsible use of AI.

Figures & tables

Explore similar work

CardsList
  1. Can AI Guide Testing Without Generating Tests? A Comparative Study of AI-Assisted Unit Testing

    Oct 26, 2026Zihan Fang, Ron Asoulin-Handelman, Helen Wu +2Computer Science EducationGenerative AI in Education

  2. Unpacking Vibe Coding: Help-Seeking Processes in Student-AI Interactions While Programming

    Apr 29, 2026Daiana Rinja, Eduardo Araujo Oliveira, Sonsoles López-Pernas +3AI in EducationProgramming Education