The AI-Powered Dialogue: Evaluating the Impact of Large Language Models on EFL Learners’ Pragmatic Competence and Speaking Anxiety
Indonesia 
Malaysia Malaysia 
Article Sidebar
-
Artificial Intelligence, EFL Learners, Large Language Models, Pragmatic Competence, Speaking Anxiety
Abstract
Background. The rapid advancement of artificial intelligence has transformed language learning environments, particularly through the integration of Large Language Models (LLMs) that facilitate interactive and personalized communication practice. Despite their growing adoption in English as a Foreign Language (EFL) education, limited empirical attention has been devoted to understanding their influence on learners’ pragmatic competence and speaking anxiety.
Purpose. This study aims to evaluate the impact of AI-powered dialogue systems based on LLMs on EFL learners’ ability to use language appropriately in social contexts and their confidence in oral communication.
Method. A quantitative quasi-experimental design was employed involving 120 EFL learners divided into experimental and control groups. Data were collected through pragmatic competence assessments, speaking anxiety scales, classroom observations, and structured interviews.
Results. Findings indicate that students who engaged with AI-powered dialogue systems demonstrated significantly higher gains in pragmatic competence compared to those receiving conventional instruction. Results also reveal a substantial reduction in speaking anxiety, attributed to the non-judgmental, adaptive, and accessible nature of AI-mediated interactions.
Conclusion. The study concludes that LLM-based dialogue platforms provide meaningful opportunities for authentic communication practice while fostering psychological comfort in language learning. Integrating AI-powered dialogue into EFL instruction can therefore enhance communicative effectiveness and support learners’ confidence in real-world language use.
Full text article
References
Abdallah, N., Katmah, R., Khalaf, K., & Jelinek, H. F. (2025). Systematic review of ChatGPT in higher education: Navigating impact on learning, wellbeing, and collaboration. Social Sciences & Humanities Open, 12, 101866. https://doi.org/10.1016/j.ssaho.2025.101866
Abdelfattah, M., Naeem, M., Al Mata’ni, A., Basu, S., Pecelj, S., Charni, S., Mathew, M., Wedderburn, M., Lamti, M., Shawky, W. M., Khan, S., Awladwadair, R., Al Ghawi, A., & El Kamili, S. (2026). Enhancing EFL Learners’ Speaking Proficiency and Confidence Using AI-Conversational Apps: International Journal of Computer-Assisted Language Learning and Teaching, 16(1). https://doi.org/10.4018/IJCALLT.409358
Albadry, H. (2025). The Integration of Artificial Intelligence Into Saudi Educational Settings: International Journal of Computer-Assisted Language Learning and Teaching, 15(1). https://doi.org/10.4018/IJCALLT.394883
Aljohani, N. J. (2026). ChatGPT in language learning: A systematic review of applications and challenges. Social Sciences & Humanities Open, 13, 102357. https://doi.org/10.1016/j.ssaho.2025.102357
Almahasneh, A. M. S., Aljarrah, M. M. Y., Sider, L. M., Alshamalat, R. Y., & ali alnaimat, W. (2026). The Role of AI Facebook Messenger Bot on Writing Practice among Arab EFL University Students. 7th International Conference on AI in Computational Linguistics, 275, 931–940. https://doi.org/10.1016/j.procs.2026.01.106
Amiri, M., & Ramezanzadeh, A. (2026). Probing into the use of politeness strategies in human-chatbots conversations: A qualitative analysis of EFL learners’ socio-pragmatic competence in artificial intelligence-generated interactions. Ampersand, 16, 100273. https://doi.org/10.1016/j.amper.2026.100273
Arslan, S. (2025). English-as-a-foreign language university instructors’ perceptions of integrating artificial intelligence: A Turkish perspective. System, 131, 103680. https://doi.org/10.1016/j.system.2025.103680
Chen, H. (2026). AI-generated content and business English speaking: A mixed-methods study of SpeakGuru’s impact on performance, motivation, and engagement. Acta Psychologica, 264, 106481. https://doi.org/10.1016/j.actpsy.2026.106481
Choi, W. (2025). The role of changes in pronunciation ability and anxiety through Gen-AI on EFL learners’ self-directed speaking motivation and social interaction confidence—A CHAT perspective. System, 133, 103788. https://doi.org/10.1016/j.system.2025.103788
Choi, W. (2026). Beyond anxiety reduction: Psychological transformation and systemic contradictions in generative-AI-mediated language learning – A cultural-historical activity theory perspective. Acta Psychologica, 267, 107055. https://doi.org/10.1016/j.actpsy.2026.107055
Dai, H., & Chen, G. (2026). Impact of Gather Town on EFL Listening Processing Speed and Performance Within an OBE Framework. International Journal of Web-Based Learning and Teaching Technologies, 21(1). https://doi.org/10.4018/IJWLTT.400916
Dong, J., & Han, Y. (2024). Examining Chinese teachers’ emotional vulnerability of teaching international students in an English medium instruction programme. System, 122, 103297. https://doi.org/10.1016/j.system.2024.103297
Jindapitak, N., & Tantiwich, K. (2025). I’m from Singapore lah: AI-simulated interlocutors’ responses during in-the-cloud interviews with Thai EFL learners. Ampersand, 15, 100241. https://doi.org/10.1016/j.amper.2025.100241
Khan, M. S. H., & Habib, R. B. (2026). Exploring the role of learner aptitude and engagement in ChatGPT-assisted writing tasks: Evidence from Bangladeshi undergraduates. Computers in Human Behavior Reports, 22, 101099. https://doi.org/10.1016/j.chbr.2026.101099
Kralova, Z., & Kunova, R. (2026). Longitudinal Comparison of Artificial Intelligence-Based and Human Evaluations of English-as-a-Foreign-Language Pronunciation. International Journal of Computer-Assisted Language Learning and Teaching, 16(1). https://doi.org/10.4018/IJCALLT.404749
Lai, Z. C.-C. (2025). Enhancing EFL Oral Proficiency Through a ChatGPT-Integrated BOPPPS Learning Framework. International Journal of Online Pedagogy and Course Design, 15(1). https://doi.org/10.4018/IJOPCD.383301
Lei, H. (2026). Rhetorical shifts in the AI age: A Metadiscourse analysis of applied linguistics master’s theses in the Chinese EFL context. Linguistics and Education, 92, 101508. https://doi.org/10.1016/j.linged.2026.101508
Li, B., Tan, Y. L., Wang, C., & Lowell, V. (2025). Two years of innovation: A systematic review of empirical generative AI research in language learning and teaching. Computers and Education: Artificial Intelligence, 9, 100445. https://doi.org/10.1016/j.caeai.2025.100445
Li, L., Zhang, X., Zou, B., & Yang, Q. (2025). AI partner or peer partner? Exploring AI-mediated interaction in EFL pronunciation from a socio-cultural perspective. Learning, Culture and Social Interaction, 55, 100958. https://doi.org/10.1016/j.lcsi.2025.100958
Liang, H. (2025). How emotions shape engagement in EMI classrooms: A configurational fsQCA approach. System, 134, 103844. https://doi.org/10.1016/j.system.2025.103844
Liu, C., & Liang, M. (2026). The effects of AI-assisted feedback on students’ perceptions, emotions, and learning outcomes in L2 writing: A three-level meta-analysis. System, 139, 104018. https://doi.org/10.1016/j.system.2026.104018
Liu, G. L., & Soyoof, A. (2026). Does informal digital language learning really contribute to second language achievement? Evidence from a multilevel meta-analysis. System, 139, 104036. https://doi.org/10.1016/j.system.2026.104036
Liu, M., Hashim, H., & Sulaiman, N. A. (2026). Longitudinal development of L2 speaking accuracy in AI-enhanced smart class: Evidence from an error-annotated learner corpus. System, 140, 104048. https://doi.org/10.1016/j.system.2026.104048
Masjedy, H., & Adel, S. M. R. (2025). Fuzzy logic theory: A unifying pathway to intelligent accountability in addressing methodological challenges of applied linguistics. Research Methods in Applied Linguistics, 4(3), 100278. https://doi.org/10.1016/j.rmal.2025.100278
McKinley, J., Zhang, L. J., Elola, I., Hennebry-Leung, M., Zheng, Y., Greenier, V., Thomas, N., & Matzler, P. (2024). Fifty years of System research and projections for the future. System, 121, 103210. https://doi.org/10.1016/j.system.2023.103210
Namaziandost, E., & Çelik, F. (2025). Simulated uncertainty in gamified language learning: Investigating resilience, academic buoyancy, and on-task focus through the lens of expectancy-value theory and operant conditioning. Learning and Motivation, 92, 102196. https://doi.org/10.1016/j.lmot.2025.102196
Qin, W., Wang, W., & Zheng, Y. (2025). Enhancing argumentative writing with data-driven learning: Exploring developmental trajectories and learner profiles. Learning and Individual Differences, 124, 102800. https://doi.org/10.1016/j.lindif.2025.102800
Sun, Y., & Lan, G. (2025). Enhancing critical language awareness in EAL writing education amid the rise of generative artificial intelligence. System, 134, 103806. https://doi.org/10.1016/j.system.2025.103806
Tang, W. K.-W., & Zhang, X.-Y. (2026). Artificial Intelligence in English as a foreign language learning: A systematic review of technologies, tools, and their impacts. Computers and Education: Artificial Intelligence, 10, 100595. https://doi.org/10.1016/j.caeai.2026.100595
Taye, T. (2026). Students’ and instructors’ perceptions of reading strategy effectiveness: Insights from Communicative English Skills courses at an Ethiopian higher education institution. Social Sciences & Humanities Open, 13, 102833. https://doi.org/10.1016/j.ssaho.2026.102833
Wang, C., Zou, B., Du, Y., & Wang, Z. (2024). The impact of different conversational generative AI chatbots on EFL learners: An analysis of willingness to communicate, foreign language speaking anxiety, and self-perceived communicative competence. System, 127, 103533. https://doi.org/10.1016/j.system.2024.103533
Wang, X., & Hasim, Z. (2024). A Bibliometric Analysis on Trends and Patterns in Self-Regulated Language Learning in Mobile-Assisted Learning Environments. International Journal of Computer-Assisted Language Learning and Teaching, 14(1). https://doi.org/10.4018/IJCALLT.345401
Wiboolyasarin, W., Wiboolyasarin, K., Tiranant, P., Jinowat, N., & Boonyakitanont, P. (2025). AI-driven chatbots in second language education: A systematic review of their efficacy and pedagogical implications. Ampersand, 14, 100224. https://doi.org/10.1016/j.amper.2025.100224
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 100134. https://doi.org/10.1016/j.caeai.2023.100134
Zhang, Y., Lai, C., & Gu, M. M. Y. (2025). Becoming a teacher in the era of AI: A multiple-case study of pre-service teachers’ investment in AI-facilitated learning-to-teach practices. System, 133, 103746. https://doi.org/10.1016/j.system.2025.103746
Zhao, W. (2026). Comparative Study on the Effect of Intelligent Voice Technology and Traditional Listening and Speaking Teaching. International Journal of Mobile Human Computer Interaction, 17(1). https://doi.org/10.4018/IJMHCI.407993
Authors
Copyright (c) 2026 Delsa Miranty, Haziq Idris, Rina Farah
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
