Can AI chatbots effectively improve EFL learners’ learning effects?—A meta-analysis of empirical research from 2022–2024

Technology development has brought transformative changes to the field of education, with AI chatbots injecting new vitality into language learning. To clarify the effectiveness of AI-powered chatbots in enhancing learners’ English language acquisition, this study systematically employed meta-analysis to review 25 peer-reviewed studies published between 2022 and 2024. The results indicate that AI chatbots significantly enhance learners’ academic performance, positively influencing their language skills as well as their psychological and emotional well-being. Key moderating factors include intervention duration, chatbot role, and chatbot form. Longer intervention periods correlated positively with better learning effects; AI chatbots as learning companions were more effective; and AI chatbots with mechanical appearances had a greater impact on learning. However, educational levels and teacher roles did not significantly affect the moderating effects. This paper offers practical recommendations for integrating AI chatbots into EFL learning and suggests future research directions, providing valuable evidence and insights into their effectiveness in EFL education.