AFFECTIVE COMPUTING AND AI: DEVELOPING EMOTION-AWARE VIRTUAL TUTORS FOR PERSONALIZED FEEDBACK IN HYBRID LEARNING

Ali Khan (1), Daiki Nishida (2), Miku Fujita (3), Lim Haeun (4)
(1) Lahore University of Management Sciences (LUMS), Pakistan,
(2) Chuo University, Japan,
(3) University of Kyoto, Japan,
(4) Ewha Womans University, Korea, Republic of

Abstract

The rapid integration of artificial intelligence (AI) into education has opened new possibilities for personalized learning, yet emotional engagement remains an underdeveloped dimension in hybrid learning environments. Traditional AI tutoring systems primarily focus on cognitive adaptation, often neglecting the affective aspects that influence student motivation, attention, and persistence. This study explores the use of affective computing to develop emotion-aware virtual tutors capable of recognizing and responding to learners’ emotional states in real time. The research aims to design and evaluate a hybrid AI tutoring model that integrates facial expression recognition, voice sentiment analysis, and physiological data interpretation to deliver adaptive emotional feedback. The study employed a mixed-method approach combining system prototyping, experimental testing, and learner experience evaluation. Data were collected from 120 middle and university students engaged in hybrid science courses, using emotion-recognition accuracy rates, engagement indices, and qualitative interviews as core evaluation metrics. Results showed that the emotion-aware tutor achieved an average recognition accuracy of 91.2% and improved learner engagement by 34% compared to traditional AI tutors. Students reported higher satisfaction and felt more connected to the virtual tutor, indicating that emotional responsiveness enhanced trust and motivation. The findings demonstrate that affective AI systems can humanize digital learning interactions, providing affect-sensitive feedback that complements cognitive personalization. Future research should explore ethical frameworks for emotion data privacy and expand cross-cultural models of emotional intelligence in AI tutoring.

Full text article

Generated from XML file

References

Ching, Y.-C., & Ho, Y.-C. (2025). AI Virtual Human–Augmented Game-Based Teaching to Enhance Emotional Intelligence in Nursing Students: Protocol for a Single-Group Pretest-Posttest Action Research Study. JMIR Research Protocols, 14. https://doi.org/10.2196/80290

Ciraolo, D., Fazio, M., Calabrò, R. S., Villari, M., & Celesti, A. (2024). Facial expression recognition based on emotional artificial intelligence for tele-rehabilitation. Biomedical Signal Processing and Control, 92, 106096. https://doi.org/10.1016/j.bspc.2024.106096

Deng, W. (2025). AI and knowledge sharing in team performance: Emotional intelligence as the mediator between coordination and performance. Sustainable Futures, 10, 101434. https://doi.org/10.1016/j.sftr.2025.101434

Desroche, L.-M., Trimaille, A., Garban, T., & Bouleti, C. (2025). Artificial intelligence in cardiovascular medicine: An exoskeleton for perception, reasoning and action. Archives of Cardiovascular Diseases, 118(11), 613–620. https://doi.org/10.1016/j.acvd.2025.07.012

Liu, H., Fan, J., & Xia, M. (2025). Exploring individual’s emotional and autonomous learning profiles in AI-enhanced data-driven language learning: An expanded sor perspective. Learning and Individual Differences, 122, 102753. https://doi.org/10.1016/j.lindif.2025.102753

Mosleh, S. M., Alsaadi, F. A., Alnaqbi, F. K., Alkhzaimi, M. A., Alnaqbi, S. W., & Alsereidi, W. M. (2024). Examining the association between emotional intelligence and chatbot utilization in education: A cross-sectional examination of undergraduate students in the UAE. Heliyon, 10(11), e31952. https://doi.org/10.1016/j.heliyon.2024.e31952

Ooki, R., Shintani, M., Nagasawa, S., & Yonemitsu, F. (2025). Dimensions of Perceived Humanness in Artificial Faces: Evaluating Anatomical and Affective Impressions in the Uncanny Valley. 29th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES 2025), 270, 5157–5166. https://doi.org/10.1016/j.procs.2025.09.643

Orji, J., Chan, G., & Orji, R. (2025). Revitalizing wellbeing: App design for stress reduction through artificial intelligence and persuasive technology. International Journal of Human-Computer Studies, 204, 103600. https://doi.org/10.1016/j.ijhcs.2025.103600

Sadaf, A., Maxwell, D., Küplüce, C., & Holz, H. (2025). Relationship between pre-service teachers’ perceived competencies, affective dispositions, and readiness to use artificial intelligence: A study informed by the intelligent-TPACK. Computers and Education Open, 9, 100305. https://doi.org/10.1016/j.caeo.2025.100305

Shahini, A. (2025). Emotional dimensions of feedback: How AI and human responses shape ESL learning outcomes. Ampersand, 15, 100235. https://doi.org/10.1016/j.amper.2025.100235

Volpato, R., DeBruine, L., & Stumpf, S. (2025). Trusting emotional support from generative artificial intelligence: A conceptual review. Computers in Human Behavior: Artificial Humans, 5, 100195. https://doi.org/10.1016/j.chbah.2025.100195

Wu, J., Cao, R., Zhang, Y., & Li, Y. (2025). A multi-agent automated negotiation model based on the artificial bee colony algorithm with an emotional guidance mechanism. Advanced Engineering Informatics, 68, 103664. https://doi.org/10.1016/j.aei.2025.103664

Wu, X.-Y. (2024). Artificial Intelligence in L2 learning: A meta-analysis of contextual, instructional, and social-emotional moderators. System, 126, 103498. https://doi.org/10.1016/j.system.2024.103498

Xia, M., & Guo, S. (2025). Understanding learners’ perceptions of artificial intelligence-mediated Informal Digital Learning of English: A Q methodology approach. Acta Psychologica, 261, 105980. https://doi.org/10.1016/j.actpsy.2025.105980

Xia, Q., Li, W., Yang, Y., Weng, X., & Chiu, T. K. F. (2025). A systematic review and meta-analysis of the effectiveness of Generative Artificial Intelligence (GenAI) on students’ motivation and engagement. Computers and Education: Artificial Intelligence, 9, 100455. https://doi.org/10.1016/j.caeai.2025.100455

Zhao, C., & Yu, J. (2024). Relationship between teacher’s ability model and students’ behavior based on emotion-behavior relevance theory and artificial intelligence technology under the background of curriculum ideological and political education. Learning and Motivation, 88, 102040. https://doi.org/10.1016/j.lmot.2024.102040

Zou, B., Wang, C., He, H., Li, C., Purwanto, E., & Wang, P. (2025). Enhancing EFL writing with visualised GenAI feedback: A cognitive affective theory of learning perspective on revision quality, emotional response, and human-computer interaction. Learning and Motivation, 91, 102158. https://doi.org/10.1016/j.lmot.2025.102158

Authors

Ali Khan
alikhan@gmail.com (Primary Contact)
Daiki Nishida
Miku Fujita
Lim Haeun
Khan, A., Nishida, D. ., Fujita, M. ., & Haeun, L. . (2025). AFFECTIVE COMPUTING AND AI: DEVELOPING EMOTION-AWARE VIRTUAL TUTORS FOR PERSONALIZED FEEDBACK IN HYBRID LEARNING. Journal Neosantara Hybrid Learning, 3(2), 79–91. https://doi.org/10.70177/jnhl.v3i2.2824

Article Details