Investigating the Pedagogical Effectiveness of AI-Based Translation Tools in Fostering EFL Writing Skills and EFL Vocabulary Skills at Al Madinah International University

Abstract

Abstract: Artificial intelligence (AI) tools are increasingly converting language education by providing modern tools that support language learning and writing development. Among these tools, AI-driven translation tools have gained attention for their potential to assist English as a Foreign Language (EFL) learners in improving writing performance and expanding vocabulary knowledge. Despite their growing use, experimental evidence on their efficacy in higher education contexts remains limited. This study investigated the impact of AI-driven translation tools on EFL students’ writing skills and vocabulary acquisition at Al Madinah International University. Specifically, it aimed to examine whether the use of AI translation tools—DeepL, ChatGPT, and Google Gemini—could significantly improve students’ writing performance, vocabulary development, and learning autonomy. A quasi-experimental design was employed with 30 EFL students divided into a control group (N = 15) and an experimental group (N = 15). Data were collected through pre- and post-intervention writing and vocabulary assessments and analyzed using the Mann–Whitney and Wilcoxon Signed-Rank tests. The findings revealed statistically significant improvements in both writing and vocabulary outcomes among students who used AI translation tools. The intervention produced notable gains in overall writing performance, particularly in the “Content and Ideas” sub-skill (effect size = 0.750). Similarly, the treatment demonstrated a substantial impact on vocabulary learning (effect size = 1), improving most sub-skills except “Discriminating Vocabulary Nuances.” Participants also reported increased confidence and autonomy in their learning process. These results suggest that AI-driven translation tools can serve as effective supplementary resources in EFL instruction, with important implications for curriculum design and the strategic integration of AI technologies in higher education language learning environments.

Keywords: AI-based translation tools, EFL writing skills, EFL vocabulary skills