ASSESSING COLLABORATIVE SKILLS IN A HYBRID PROJECT: A NOVEL FRAMEWORK AND RUBRIC FOR INDONESIAN HIGHER EDUCATION
Article Sidebar
-
Assessment Framework, Collaborative Skills, Hybrid Learning
Abstract
The rise of hybrid education in Indonesian higher education has necessitated the development of new assessment approaches to evaluate students’ collaborative skills in digitally mediated learning environments. Traditional group assessment methods often fail to capture the complexity of teamwork processes that occur across both face-to-face and online modalities. This study aims to design, implement, and validate a novel framework and rubric for assessing collaborative competence in hybrid project-based courses. The framework integrates dimensions of digital interaction, task coordination, communication ethics, and reflective collaboration to align with the 21st-century skill requirements in higher education. A design-based research (DBR) methodology was employed, involving three iterative cycles of development, implementation, and evaluation. Participants included 120 undergraduate students from education and engineering faculties at three Indonesian universities. Data were collected through observation, peer-assessment forms, and reflective journals, and analyzed using mixed methods—quantitative reliability testing of the rubric and qualitative thematic analysis of students’ reflections. The findings indicate that the new rubric achieved high inter-rater reliability (Cronbach’s ? = 0.89) and effectively differentiated between levels of collaborative performance. Students demonstrated increased awareness of equitable participation and digital communication norms when the rubric was integrated into formative feedback processes. The study concludes that the proposed framework and rubric offer a practical and context-sensitive tool for assessing collaboration in hybrid higher education settings. The model contributes to both pedagogical assessment design and the broader discourse on digital collaboration in Southeast Asian higher education.
Full text article
References
Abusafieh, S. F. (2025). Empowering digital transformation in higher education: Assessing the effectiveness of asynchronous online learning in architecture pedagogy. Open House International, 50(5), 928–942. https://doi.org/10.1108/OHI-01-2025-0013
Adamu, A. A., Sathappan, M., Adeyinka-Ojo, S. F., Sathappan, R., Ahmad, G. I., & Kalam, A. (2025). Effectiveness and learning outcomes of hybrid learning in Malaysian undergraduate courses. Asian Education and Development Studies, 14(5), 960–978. https://doi.org/10.1108/AEDS-07-2024-0157
Ajidarma, P., & Nof, S. Y. (2025). Skill-and-Knowledge Sharing HUB-CI model for resilient production systems. International Journal of Production Economics, 287, 109681. https://doi.org/10.1016/j.ijpe.2025.109681
Apostolopoulos, G., Andronas, D., Fourtakas, N., & Makris, S. (2022). Operator training framework for hybrid environments: An Augmented Reality module using machine learning object recognition. 9th CIRP Conference on Assembly Technology and Systems, 106, 102–107. https://doi.org/10.1016/j.procir.2022.02.162
Ballesteros-Sola, M., & Magomedova, N. (2023). Impactful social entrepreneurship education: A US-Spanish service learning collaborative online international learning (COIL) project. The International Journal of Management Education, 21(3), 100866. https://doi.org/10.1016/j.ijme.2023.100866
Belhaj, R., Ali, N. A., & Browlahrouf, I. (2025). Gamified Hybrid Learning for Neurodiverse Students: Designing Universally Accessible Instructional Models. Journal Neosantara Hybrid Learning, 3(1), 38–46. https://doi.org/10.70177/jnhl.v3i1.2229
CARVALHO, A. R., & SANTOS, C. (2022). Developing peer mentors’ collaborative and metacognitive skills with a technology-enhanced peer learning program. Computers and Education Open, 3, 100070. https://doi.org/10.1016/j.caeo.2021.100070
Ceh-Varela, E., Canto-Bonilla, C., & Duni, D. (2023). Application of Project-Based Learning to a Software Engineering course in a hybrid class environment. Information and Software Technology, 158, 107189. https://doi.org/10.1016/j.infsof.2023.107189
Chan, C. K. Y. (2025). A scoping review of empirical research on Collaborative Online International Learning (COIL) implementation. Educational Research Review, 49, 100749. https://doi.org/10.1016/j.edurev.2025.100749
Cheung, A. (2023). Developing and evaluating a set of process and product-oriented classroom assessment rubrics for assessing digital multimodal collaborative writing in L2 classes. Assessing Writing, 56, 100723. https://doi.org/10.1016/j.asw.2023.100723
de Beer, E. (E. H. M. ), van Os-Medendorp, H. (H. ), Groeneveld, S. (S. W. M. ), & Jukema, J. S. (J. S. ). (2023). Perceived contribution of a hybrid serious game to the development of collaborative problem solving among undergraduate nursing students: A mixed method design. Nurse Education in Practice, 73, 103794. https://doi.org/10.1016/j.nepr.2023.103794
Deschênes, A.-A. (2024). Digital literacy, the use of collaborative technologies, and perceived social proximity in a hybrid work environment: Technology as a social binder. Computers in Human Behavior Reports, 13, 100351. https://doi.org/10.1016/j.chbr.2023.100351
Dordevic, J., Stojanovi, L., & Markovi, T. (2025). Blockchain-Based Academic Records for Hybrid Education: Securing Digital Credentials in Global Crisis Contexts. Journal Neosantara Hybrid Learning, 3(1), 20–28. https://doi.org/10.70177/jnhl.v3i1.2231
D’Souza, C., Sithole, N., Kappelides, P., & Halimi, T. (2025). Socialisation, learning, and value co-creation: Confidence to soft employability skills for international students. Education + Training, 67(10), 150–168. https://doi.org/10.1108/ET-03-2025-0136
Fang, K. Q., & Jiang, H. (2025). A machine learning framework for evaluating basketball player skill development using video analysis. Egyptian Informatics Journal, 32, 100762. https://doi.org/10.1016/j.eij.2025.100762
Fogli, D., Gargioni, L., Guida, G., & Tampalini, F. (2022). A hybrid approach to user-oriented programming of collaborative robots. Robotics and Computer-Integrated Manufacturing, 73, 102234. https://doi.org/10.1016/j.rcim.2021.102234
Forsyth, P., Radley, A., Rushworth, G. F., Marra, F., Roberts, S., O’Hare, R., Duggan, C., & Maguire, B. (2023). The Collaborative Care Model: Realizing healthcare values and increasing responsiveness in the pharmacy workforce. Research in Social and Administrative Pharmacy, 19(1), 110–122. https://doi.org/10.1016/j.sapharm.2022.08.016
Forte, N. R., Veasey, V. N., Christie, B. J., Carter, A., Hanks, M. A., Holderfield, A., Houston, T., Challa, A. K., Turner, A. N., & Ott, L. E. (2023). Engaging students in a genetics course-based undergraduate research experience utilizing Caenorhabditis elegans in hybrid learning to explore human disease gene variants. Journal of Microbiology & Biology Education, 24(3). https://doi.org/10.1128/jmbe.00078-23
Gonzales, S., Fernandez, C., & Wei, L. (2025). Adopting Heutagogy in Non-Formal Education: A Participatory Action Research with Community Learning Centers. Journal Neosantara Hybrid Learning, 3(1), 29–37. https://doi.org/10.70177/jnhl.v3i1.2186
Han, A., Krieger, F., & Greiff, S. (2023). Assessment of collaborative problem-solving: Past achievements and current challenges. In R. J. Tierney, F. Rizvi, & K. Ercikan (Eds.), International Encyclopedia of Education (Fourth Edition) (pp. 234–244). Elsevier. https://doi.org/10.1016/B978-0-12-818630-5.09041-2
Hopkins, M., Lin, M.-H., & Nariswari, A. (2023). Collaborative technology in a hybrid learning context: Exploring feeling at ease and perceived learning among college students. International Journal of Educational Management, 37(6), 1481–1497. https://doi.org/10.1108/IJEM-11-2022-0477
Hu, S. (2022). Physical Education Teaching Quality Evaluation Method Using Collaborative Edge Computing and Social Internet of Things. International Journal of Distributed Systems and Technologies, 13(7). https://doi.org/10.4018/IJDST.307951
Hua Hu, K. (2023). An exploration of the key determinants for the application of AI-enabled higher education based on a hybrid Soft-computing technique and a DEMATEL approach. Expert Systems with Applications, 212, 118762. https://doi.org/10.1016/j.eswa.2022.118762
Istek, E., & Ironsi, C. S. (2023). Incorporating mobile learning and the CAP(E) framework in improving the receptive skills of students. Library Hi Tech, 42(2), 711–729. https://doi.org/10.1108/LHT-01-2023-0008
Jacobs, B., Taljaard-Swart, H., Marx-Pienaar, N., Diedericks, L., Sonnenberg, N., Donoghue, S., Pretorius, A., & du Rand, G. (2023). Preparing students for the future workplace: How online teaching and learning during the COVID-19 pandemic hone required transferable skills. Education + Training, 65(10), 81–97. https://doi.org/10.1108/ET-09-2022-0371
Joshi, S., & P.J., P. (2023). A Collaborative Metaverse based A-La-Carte Framework for Tertiary Education (CO-MATE). Heliyon, 9(2), e13424. https://doi.org/10.1016/j.heliyon.2023.e13424
Kapoor, B. (2022). A new perspective of learning in organisations: Eight strategies to develop skills and core competencies. Development and Learning in Organizations: An International Journal, 37(1), 11–14. https://doi.org/10.1108/DLO-12-2021-0223
Khairani, M., Huda, N., Razak, F., & Wulan, D. R. (2025). From Teacher to Facilitator: The Role of Educators in Supporting Heutagogical Practices in Higher Education. Journal Neosantara Hybrid Learning, 3(1), 1–9. https://doi.org/10.70177/jnhl.v3i1.2173
Kirkman, T., Brown, N., DeFoor, M., Seay, A., & Darby, W. (2022). Enriching Nursing Simulation With a Threefold Hybrid Approach. Clinical Simulation in Nursing, 68, 34–41. https://doi.org/10.1016/j.ecns.2022.04.008
Lehtinen, A., Kostiainen, E., & Näykki, P. (2023). Co-construction of knowledge and socioemotional interaction in pre-service teachers’ video-based online collaborative learning. Teaching and Teacher Education, 133, 104299. https://doi.org/10.1016/j.tate.2023.104299
Machado, R. H. C., Conceição, S. V., Pelissari, R., Amor, S. B., & Resende, T. L. (2023). A multiple criteria framework to assess learning methodologies. Thinking Skills and Creativity, 48, 101290. https://doi.org/10.1016/j.tsc.2023.101290
Mackey, M., Drew, S. V., Nicoll-Senft, J., & Jacobson, L. (2023). Advancing a theory of change in a collaborative teacher education program innovation through universal design for learning. Social Sciences & Humanities Open, 7(1), 100468. https://doi.org/10.1016/j.ssaho.2023.100468
Mägi, L., Uibu, E., Moi, A. L., Mortensen, M., Naustdal, K., Põlluste, K., Lember, M., & Kangasniemi, M. (2024). Collaborative learning linking nursing practice and education – Interview study with master’s students and teachers. Nurse Education Today, 139, 106261. https://doi.org/10.1016/j.nedt.2024.106261
McDonald, D., Iscaro, V., & Posey, O. G. (2022). Active learning strategies in business education: Using the law to build critical workforce skills. Journal of International Education in Business, 15(2), 406–424. https://doi.org/10.1108/JIEB-06-2021-0071
Nandamudi, S., McKnight, A., & Baird, K. (2023). Dysphagia interprofessional collaborative practice and team-based learning in graduate curriculum for students in healthcare disciplines: A pilot study. Journal of Interprofessional Education & Practice, 30, 100588. https://doi.org/10.1016/j.xjep.2022.100588
Nielsen, S., Graham, F., Hadi, M. H., Grist, E., Rowland, B., Jackson, J., Lord, S., Dostal, J., Wood, P., Morgan, K., Petrie, D., & Cheetham, A. (2025). A multisite pilot type 2 hybrid implementation-effectiveness trial of a community pharmacist-led model of collaborative care for Medication Assisted Treatment for Opioid Dependence: Outcomes of the EPIC-MATOD trial. Research in Social and Administrative Pharmacy. https://doi.org/10.1016/j.sapharm.2025.10.009
Oliveira, M., Zednik, C., Bombaerts, G., Sadowski, B., & Conijn, R. (2025). Assessing students’ DRIVE: A framework to evaluate learning through interactions with generative AI. Computers and Education: Artificial Intelligence, 9, 100497. https://doi.org/10.1016/j.caeai.2025.100497
Oropesa, I., Sánchez-Peralta, L. F., Guzmán García, C., Chmarra, M. K., Berner-Juhos, K., Tiu, C., Mettouris, C., Papadopoulos, G. A., Papadopoulos, A., Blas Pagador, J., Post, J., Dankelman, J., González-Segura, A., Sánchez-Margallo, F. M., & Gómez, E. J. (2023). EASIER: A new model for online learning of minimally invasive surgery skills. International Journal of Medical Informatics, 180, 105269. https://doi.org/10.1016/j.ijmedinf.2023.105269
Ortega-Arranz, A., Amarasinghe, I., Martínez-Monés, A., Asensio-Pérez, J. I., Dimitriadis, Y., Corrales-Astorgano, M., & Hernández-Leo, D. (2024). Collaborative activities in hybrid learning environments: Exploring teacher orchestration load and students’ perceptions. Computers & Education, 219, 105105. https://doi.org/10.1016/j.compedu.2024.105105
Pan, S., Hafez, B., Iskandar, A., & Ming, Z. (2024). Integrating constructivist principles in an adaptive hybrid learning system for developing social entrepreneurship education among college students. Learning and Motivation, 87, 102023. https://doi.org/10.1016/j.lmot.2024.102023
Passman, J. E., Khue, D. K., Thanh, Q. N., Yi, W., Temel, D., Roberson, J. L., Wachtel, H., Gaulton, G. N., Morrison, G., & Brooks, A. D. (2024). Collaborative Development and Implementation of a Hybrid Virtual Surgery Clerkship Curriculum in a Vietnamese Medical School. Journal of Surgical Education, 81(8), 1099–1104. https://doi.org/10.1016/j.jsurg.2024.05.001
Perisic, A., Perisic, I., Lazic, M., & Perisic, B. (2023). The foundation for future education, teaching, training, learning, and performing infrastructure—The open interoperability conceptual framework approach. Heliyon, 9(6), e16836. https://doi.org/10.1016/j.heliyon.2023.e16836
Radzi, S., Tan, J. S., Rajalingam, P., Cleland, J., & Mogali, S. R. (2025). Developing and Testing a Framework for Learning Online Collaborative Creativity in Medical Education: Cross-Sectional Study. JMIR Formative Research, 9. https://doi.org/10.2196/50912
Shaw, L., Turick, M., & Kiegaldie, D. (2025). Collaborative online international learning in health professions education: A 10-year scoping review. Nurse Education Today, 148, 106602. https://doi.org/10.1016/j.nedt.2025.106602
Vann, R., Rith, V., & Suyitno, S. (2025). Community-Based Social Education for Sustainable Development – An Indonesian Perspective on Collaborative Learning Models. Journal Neosantara Hybrid Learning, 3(1), 10–19. https://doi.org/10.70177/jnhl.v3i1.2174
Authors
Copyright (c) 2025 Bilal Aslam, Shahinur Rahman, Tasnia Islam, Ruhul Amin
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
