Teaching with Tech or Text? A Meta-Analysis for Evidence-Based Reading Instruction

Muhammad Iqbal Ripo Putra (1), Dedi Irwan (2), Aunurrahman Aunurrahman (3), Sulaiman Sulaiman (4), Nurussaniah Nurussaniah (5)
(1) Universitas PGRI PontianakID Indonesia,
(2) Universitas PGRI PontianakID Indonesia,
(3) Universitas PGRI PontianakID Indonesia,
(4) University of DundeeGB United Kingdom,
(5) Universitas PGRI PontianakID Indonesia

Abstract

Background. The rapid integration of digital reading in higher education has changed how students engage with academic texts. Conflicting evidence remains on whether digital formats support reading comprehension as well as print. This gap matters given the growing reliance on screen-based learning and the cognitive demands of academic reading..


Purpose. This meta-analysis examined whether technology-enhanced reading improves comprehension compared to print among undergraduate students. The study addressed three aspects: (1) overall differences in comprehension between digital and print formats, (2) variations across pre-, during-, and post-COVID periods, and (3) the moderating role of text modality (text-only vs. multimodal).


Method. Following PRISMA guidelines, this study synthesised data from 13 empirical studies published between 2017 and 2025, involving 1,029 undergraduate students across L1, L2, and EFL contexts. Effect sizes were calculated using Hedges' g within a random-effects model. Subgroup and meta-regression analyses were conducted to examine moderating variables.


Results. The findings showed a small but statistically significant advantage for print reading over digital formats (g = 0.265, p < .001). This advantage was more pronounced in post-pandemic studies (g = 0.333) and in text-only materials (g = 0.291), while multimodal texts showed greater variability. Meta-regression indicated no significant change in effect size over time, and publication bias was minimal. Print reading consistently supported deeper comprehension, particularly for cognitively demanding academic texts.


Conclusion. Print yields stronger comprehension than digital formats in undergraduate reading, especially for complex academic texts. This meta-analysis informs teaching practice by recommending print for high-stakes reading and metacognitive scaffolding when digital formats are used.

Full text article

Generated from XML file

References

Adams, R. L., & Wiley, J. (2025). Impact of prior knowledge and presentation on the place-on-the-page effect. Discourse Processes, 62(6–7), 437–456. https://doi.org/10.1080/0163853X.2025.2476326

Ahmed, W. M. A. (2021). Exploring EFL university learners’ acquisition of advanced reading skills in the Yemeni context. Indonesian Journal of Applied Linguistics, 10(3), 671–680. https://doi.org/10.17509/ijal.v10i3.31765

Anggraini, M. P., Cahyono, B. Y., Anugerahwati, M., & Ivone, F. M. (2022). The interaction effects of reading proficiency and personality types on EFL university students’ online reading strategy use. Education and Information Technologies, 27(7), 8821–8839. https://doi.org/10.1007/s10639-022-10979-9

Aziz, M., Hassan, A., & Aljamili, O. (2024). The effect of paper reading versus screen reading on the inferential reading performance among university ESL learners. Jurnal Arbitrer, 11(1), 85–95. https://doi.org/10.25077/ar.11.1.85-95.2024

Baron, N. S. (2017). Reading in a digital age. Phi Delta Kappan, 99(2), 15–20. https://doi.org/10.1177/0031721717734184

Baron, N. S. (2021). How we read now: Strategic choices for print, screen, and audio. Oxford University Press.

Bergman, L. (2024). Students’ reading in higher education: Challenges and ways forward. Journal of Adolescent & Adult Literacy, 67(6), 414–423. https://doi.org/10.1002/jaal.1346

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021). Introduction to meta-analysis (2nd ed.). Wiley.

Bury, S. (2016). Learning from faculty voices on information literacy: Opportunities and challenges for undergraduate information literacy education. Reference Services Review, 44(3), 237–252. https://doi.org/10.1108/RSR-11-2015-0047

Bresó-Grancha, N., Jorques-Infante, M. J., & Moret-Tatay, C. (2022). Reading digital- versus print-easy texts: A study with university students who prefer digital sources. Psicologia: Reflexão e Crítica, 35, 10. https://doi.org/10.1186/s41155-022-00212-4

Chang, L., Wang, Y., Liu, J., Feng, Y., & Zhang, X. (2023). Study on factors influencing college students’ digital academic reading behavior. Frontiers in Psychology, 13, 1007247. https://doi.org/10.3389/fpsyg.2022.1007247

Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta-analysis. Journal of Research in Reading, 42(2), 288–325. https://doi.org/10.1111/1467-9817.12269

Coiro, J. (2021). Toward a multifaceted heuristic of digital reading to inform assessment, research, practice, and policy. Reading Research Quarterly, 56(1), 9–31. https://doi.org/10.1002/rrq.302

De-la-Peña, M., Chaves-Yuste, J., & Luque-Rojas, M. J. (2024). Comparing digital and printed reading comprehension in university students: A meta-analytic study. Journal of Educational Computing Research. Advance online publication. https://doi.org/10.1177/07356331241237365

de-la-Peña, C., Chaves-Yuste, B., & Luque-Rojas, M. J. (2024). Bridging the printed or digital controversy: A meta-analysis of the impact of digital and print resources on college students’ reading comprehension. Journal of College Reading and Learning, 54(2), 79–102. https://doi.org/10.1080/10790195.2024.2350949

Delgado, P., Vargas, C., Ackerman, R., Salmerón, L., & Ibáñez-Alfonso, J. A. (2018). Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension. Educational Research Review, 25, 23–38. https://doi.org/10.1016/j.edurev.2018.09.003

Delgado, P., & Salmerón, L. (2022). Cognitive effort in text processing and reading comprehension in print and on tablet: An eye-tracking study. Discourse Processes, 59(4), 237–274. https://doi.org/10.1080/0163853X.2022.2030157

Diningrat, S. W. M., Setyosari, P., Ulfa, S., & others. (2023). The effect of an extended flipped classroom model for fully online learning and its interaction with working memory capacity on students’ reading comprehension. Journal of New Approaches in Educational Research, 12(1), 77–99. https://doi.org/10.7821/naer.2023.1.1073

Dontre, A. J. (2021). The influence of technology on academic distraction: A review. Human Behavior and Emerging Technologies, 3(3), 379–390. https://doi.org/10.1002/hbe2.229

Edwards, A. A., Daucourt, M. C., Hart, S. A., & Schatschneider, C. (2023). Measuring reading anxiety in college students. Reading and Writing, 36, 1145–1180. https://doi.org/10.1007/s11145-022-10324-z

Grabe, W. (2016). L2 reading comprehension and development. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (Vol. 3, pp. 530–542). Routledge. https://doi.org/10.4324/9781315716893-22

Grabe, W., & Yamashita, J. (2023). Research-based reading instruction. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics (2nd ed.). Wiley-Blackwell. https://doi.org/10.1002/9781405198431.wbeal1174.pub3

Hargreaves, H., Robin, S., & Caldwell, E. (2022). Student perceptions of reading digital texts for university study. Journal of Learning Development in Higher Education, (24). https://doi.org/10.47408/jldhe.vi24.817

Hermena, E. W., Sheen, M., AlJassmi, M., AlFalasi, K., AlMatroushi, M., & Jordan, T. R. (2017). Reading rate and comprehension for text presented on tablet and paper: Evidence from Arabic. Frontiers in Psychology, 8, 257. https://doi.org/10.3389/fpsyg.2017.00257

Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557

Holsey Foss, V., Støle, H., & Magyari, L. (2025). The impact of reading medium on text comprehension among vocational students. Scandinavian Journal of Educational Research, 1–15. https://doi.org/10.1080/00313831.2025.2506387

Inie, N., Barkhuus, L., & Brabrand, C. (2021). Interacting with academic readings: A comparison of paper and laptop. Social Sciences & Humanities Open, 4(1), 100226. https://doi.org/10.1016/j.ssaho.2021.100226

Jeong, Y. J., & Gweon, G. (2021). Advantages of print reading over screen reading: A comparison of visual patterns, reading performance, and reading attitudes across paper, computers, and tablets. International Journal of Human–Computer Interaction, 37(17), 1674–1684. https://doi.org/10.1080/10447318.2021.1908668

Jian, Y. C. (2022). Reading in print versus digital media uses different cognitive strategies: Evidence from eye movements during science-text reading. Reading and Writing, 35, 1549–1568. https://doi.org/10.1007/s11145-021-10246-2

Kaban, A. (2021). Gamified E-Reading Experiences and Their Impact on Reading Comprehension and Attitude in EFL Classes. International Journal of Mobile and Blended Learning, 13, 71–90. https://doi.org/10.4018/IJMBL.2021070105

Kayg?s?z, Ç. (2025). Comparison of digital and printed text reading process. Education and Information Technologies, 30(1). https://doi.org/10.1007/s10639-025-13668-5

Kazazo?lu, S. (2020). The impact of digital reading on reading comprehension: A meta-analysis. Journal of Language and Linguistic Studies, 16(1), 145–163. https://dergipark.org.tr/tr/pub/jlls/issue/53516/712879

Khan, A. U., Ajani, Y. A., & Enakrire, R. T. (2023). From traditional to emerging technologies in supporting smart libraries: A bibliometric and thematic approach from 2013 to 2022. Library Hi Tech, 41(4), 123–145. https://doi.org/10.1108/LHT-07-2023-0280

Khotimah, K., Basthomi, Y., & Eliyanah, E. (2024). EFL students’ self-selected reading in technology-mediated distance learning: A space for learner autonomy. The Journal of Asia TEFL, 21(1), 217–226. https://doi.org/10.18823/asiatefl.2024.21.1.14.217

Kong, Y., Seo, Y., & Zhai, L. (2018). Comparison of reading performance on screen and on paper: A meta-analysis. Computers & Education, 123, 138–149. https://doi.org/10.1016/j.compedu.2018.05.005

Lavoie, S., Deschênes, M.-F., & Rahimaly, N. (2021). Reading on paper versus screen in health education: A systematic review and meta-analysis. Medical Education, 55(10), 1104–1116. https://doi.org/10.1111/medu.14540

Latini, N., Bråten, I., & Salmerón, L. (2020). Does reading medium affect processing and integration of textual and pictorial information? A multimedia eye-tracking study. Contemporary Educational Psychology, 62, 101870. https://doi.org/10.1016/j.cedpsych.2020.101870

Li, Y., & Yan, L. (2024). Which reading comprehension is better? A meta-analysis of the effect of paper versus digital reading in recent 20 years. Telematics and Informatics Reports, 14, 100142. https://doi.org/10.1016/j.teler.2024.100142

Liu, T. C., Lin, C. C., & Huang, C. W. (2022). Beyond convenience: Investigating the effects of digital reading environments on university students’ metacognition and comprehension. Computers & Education, 186, 104538. https://doi.org/10.1016/j.compedu.2022.104538

Luo, J., Cao, J., Chan, K., & Yeung, P. S. (2025). Examining the effects of digital academic reading among university students: An integrated framework of three-level digital divide and executive function. International Journal of Human–Computer Interaction, 1–10. https://doi.org/10.1080/10447318.2025.2476708

Mayer, R. E. (2001). Multimedia Learning. Cambridge University Press.

Mayer, R. E. (2005). The Cambridge Handbook of Multimedia Learning. Cambridge University Press.

Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 43–71). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005

Mizrachi, D., & Salaz, A. M. (2022). Reading format attitudes in the time of COVID. The Journal of Academic Librarianship, 48(6), Article 102598. https://doi.org/10.1016/j.acalib.2022.102598

Nguyen, L. T. (2024). Digital reading of undergraduate students in Vietnamese universities: A focus group study. Library Management, 45(1–2), 71–87. https://doi.org/10.1108/LM-06-2023-0052

Ntereke, B. B., & Ramoroka, B. T. (2017). Reading competency of first-year undergraduate students at University of Botswana: A case study. Reading & Writing, 8(1), a123. https://doi.org/10.4102/rw.v8i1.123

Orellana, P., Silva, M., & Iglesias, V. (2024). Students’ reading comprehension level and reading demands in teacher education programs: The elephant in the room? Frontiers in Psychology, 15, Article 1324055. https://doi.org/10.3389/fpsyg.2024.1324055

Pedro, L. F. M. G., Barbosa, C. M. M. de O., & Santos, C. M. das N. (2018). A critical review of mobile learning integration in formal educational contexts. International Journal of Educational Technology in Higher Education, 15(1). https://doi.org/10.1186/s41239-018-0091-4

Pinandito, A., Hayashi, Y., & Hirashima, T. (2021). Online collaborative Kit-Build concept map: Learning effect and conversation analysis in collaborative learning of English as a foreign language reading comprehension. IEICE Transactions on Information and Systems, E104.D(7), 981–991. https://doi.org/10.1587/transinf.2020EDP7245

Salmerón, L., Altamura, L., Delgado, P., Karagiorgi, A., & Vargas, C. (2024). Reading comprehension on handheld devices versus on paper: A narrative review and meta-analysis of the medium effect and its moderators. Journal of Educational Psychology, 116(2), 153–172. https://doi.org/10.1037/edu0000830

Sage, K., Augustine, H., Shand, H., Bakner, K., & Rayne, S. (2019). Reading from print, computer, and tablet: Equivalent learning in the digital age. Education and Information Technologies, 24(4), 2477–2502. https://doi.org/10.1007/s10639-019-09887-2

Schwabe, A., Lind, F., Kosch, L., & Boomgaarden, H. G. (2022). No negative effects of reading on screen on comprehension of narrative texts compared to print: A meta-analysis. Media Psychology, 25(6), 779–796. https://doi.org/10.1080/15213269.2022.2070216

Segers, E., In ’t Zandt, M., Stoep, J., Daniels, L., Roelofs, J., & Gubbels, J. (2022). Differential effects and success stories of distance education in Covid-19 lockdowns on the development of reading comprehension in primary schools. Reading and Writing, 36(2), 377–400. https://doi.org/10.1007/s11145-022-10369-0

Singer, L. M., & Alexander, P. A. (2016). Reading across mediums: Effects of reading digital and print texts on comprehension and calibration. Journal of Experimental Education, 85(1), 155–172. https://doi.org/10.1080/00220973.2016.1143794

Singer, L. M., & Alexander, P. A. (2017). Reading on Paper and Digitally: What the Past Decades of Empirical Research Reveal. Review of Educational Research, 87(6), 1007–1041. https://doi.org/10.3102/0034654317722961

Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2021). Does reading anxiety impact on academic achievement in higher education students with dyslexia? Dyslexia, 27(3), 263–266. https://doi.org/10.1002/dys.1738

Suhartoyo, E., Afrilyasanti, R., & Mukminatien, N. (2025). Online classroom-based reading assessment: Comprehension and practice development. Turkish Online Journal of Distance Education, 26(1), 177–192. https://doi.org/10.17718/tojde.1414226

Tabullo, Á. J., Chiófalo, M. F., & Wainselboim, A. J. (2024). Reading comprehension in undergraduates during the COVID-19 pandemic: Associations with executive function difficulties, reading habits, and screen times. Reading Psychology, 45(1), 1–30. https://doi.org/10.1080/02702711.2023.2246972

Talwar, A., Magliano, J. P., Higgs, K., Santuzzi, A., Tonks, S., O’Reilly, T., & Sabatini, J. (2022). Early Academic Success in College: Examining the Contributions of Reading Literacy Skills, Metacognitive Reading Strategies, and Reading Motivation. Journal of College Reading and Learning, 53(1), 58–87. https://doi.org/10.1080/10790195.2022.2137069

Trakhman, L. M. S., Alexander, P. A., & Silverman, A. B. (2018). Profiling reading in print and digital mediums. Learning and Instruction, 57, 5–17. https://doi.org/10.1016/j.learninstruc.2018.04.001

Trakhman, L. M. S., Alexander, P. A., & Fusenig, J. (2025). Reading in print and digitally: Profiling and intervening in undergraduates' multimodal text processing, comprehension, and calibration. Learning and Individual Differences, 118, 102627. https://doi.org/10.1016/j.lindif.2025.102627

Trakhman, L. M. S., Alexander, P. A., & Sun, Y. (2022). The effects of processing multimodal texts in print and digitally on comprehension and calibration. The Journal of Experimental Education, 91(4), 599–620. https://doi.org/10.1080/00220973.2022.2092831

Yulia, M. F., Sulistyo, G. H., & Cahyono, B. Y. (2020). Affective engagement in academic reading: What EFL student teachers reveal. International Journal of Evaluation and Research in Education, 9(3), 791–798. https://eric.ed.gov/?id=EJ1274719

Authors

Muhammad Iqbal Ripo Putra
ripoputra87@gmail.com (Primary Contact)
Dedi Irwan
Aunurrahman Aunurrahman
Sulaiman Sulaiman
Nurussaniah Nurussaniah
Putra, M. I. R., Irwan, D., Aunurrahman, A., Sulaiman, S., & Nurussaniah, N. (2026). Teaching with Tech or Text? A Meta-Analysis for Evidence-Based Reading Instruction. International Journal of Educational Narratives, 4(3), 826–848. https://doi.org/10.70177/ijen.v4i3.3762

Article Details