Exploring how EFL students talk to and through AI to develop texts
Authors: David James Woo, Yangyang Yu, Yilin Huang, Deliang Wang, Kai Guo, Chi Ho Yeung
Organizations: Everwrite Limited, Hong Kong, China · Shanghai Jiao Tong University, Shanghai, China · The Education University of Hong Kong, Hong Kong, China · The University of Hong Kong, Hong Kong, China · The Chinese University of Hong Kong, Hong Kong, China
Generative Artificial Intelligence (AI) introduces new considerations for English as a foreign language (EFL) writing pedagogy. This study explores how students talk to and through AI by prompt engineering and negotiating authorship, respectively, and whether any patterns in the latter relate to students' writing performance. Using an exploratory mixed methods design, we analyzed screen recordings of 44 Hong Kong secondary students completing a Curricular Writing Task with AI Chatbots. Content analysis identified ten types of prompting strategies students employed, including questions, searches, and detailed instructions. From clustering these strategies, three distinct profiles of human-AI rhetorical load responsibility emerged: AI-dominant (52% of students), Human-dominant (25%) and Collaborative human-AI (14%). A MANOVA analysis indicated no significant multivariate effect of rhetorical load responsibility on three dimensions of students' writing performance: content, language, and organization. Students' prompting strategies and rhetorical load responsibility patterns have implications for their engagement and autonomy in EFL writing pedagogy.
Academic Center for Computing and Media Studies, Kyoto University, Japan · College of Information Science and Engineering, Ritsumeikan University, Japan