Impact of an Instructor's Personalized Email Intervention on Completion Rates in a Massive Open Online Course (MOOC)


  • Gila Kurtz Holon Institute of Technology
  • Orna Kopolovich Holon Institute of Technology
  • Elad Segev Holon Institute of Technology
  • Limor Sahar-Inbar Holon Institute of Technology
  • Lilach Gal Holon Institute of Technology
  • Ronen HAmmer Holon Institute of Technology



MOOC,, massive open online course, email intervention, dropout, completion rate, online learning


Although Massive Open Online Courses (MOOCs) are increasing in popularity, they have been subject to criticism due to the high dropout rate. This study examined the impact of an instructor's personalized email intervention on the rate of completion of a nine week course, which included seven weekly quizzes, and the rate of completion of the final exam. The participants, who took an Israeli noncredit academic MOOC on negotiation management, were randomly assigned to two groups. Treatment group participants (N = 576) who did not complete the weekly quiz received a tailored reminder by email from their instructor encouraging them to complete the quiz and offering them assistance in order to deal with the past week’s contents. The control group (N = 608) that did not complete the weekly quiz did not get any emails from the instructor. The impact of the intervention was measured in three different ways: the immediate-impact, the delayed-impact and a cumulative impact. The increase in quiz completion within a week after the instructor's email was defined as an immediate-impact. The increase in the completion of the next quiz was defined as a delayed impact. The increase in the final exam completion rates was defined as a cumulative impact. The results show that the weekly intervention had an immediate impact as well as a cumulative impact on the final exam completion rate. The results suggest that an instructor's acknowledgement and interest might increase learners' commitment to learning in a MOOC. This study aimed to gain insight into learners' propensity to stay active in a MOOC and to increase completion rates. Findings of this study can be useful to MOOC designers and instructors to design and facilitate more effective MOOCs for learners by using email interventions to prevent students from dropping out of courses.


Alario-Hoyos, C., Estévez-Ayres, I., Pérez-Sanagustín, M., Delgado Kloos, C. and Fernández-Panadero, C. 2017. Understanding learners’ motivation and learning strategies in MOOCs. International Review of Research in Open and Distance Learning, 18(3), pp. 120–137.

Barak, M., Watted, A. and Haick, H. 2016. Motivation to learn in massive open online courses: examining aspects of language and social engagement. Computers and Education, 94, pp. 49–60.

Baxter, J. A. and Haycock, J. 2014. Roles and student identities in online large course forums: implications for practice", International Review of Research in Open and Distance Learning, 15(1), pp. 21–40.

Breslow, L., E. Pritchard, D., DeBoer, J., S. Stump, G., Ho, D., A. and T. Seaton, D. 2013. Studying learning in the worldwide classroom research into edX’s first MOOC. Research & Practice in Assessment, 8, pp. 13–25.

Borrella, I., Caballero-Caballero, S. and Ponce-Cueto, E. 2019. Predict and intervene: Addressing the dropout problem in a MOOC-based program. In: Proceedings of the 6th 2019 ACM Conference on Learning@ Scale, pp. 1–9.

Chaw, Y. L. and Tang, M. C. 2019. Driving high inclination to complete massive open online courses (MOOCs): motivation and engagement factors for learners The Electronic Journal of e-Learning, 17(2), pp. 118–130. Available from

[Accessed 10 August 2021]

Chen, Y., Gao, Q., Yuan, Q. and Tang, Y. 2019. Facilitating students’ interaction in MOOCs through timeline-anchored discussion. International Journal of Human-Computer Interaction, 35(19), pp. 1781–1799.

Cheng, H. F., Yu, B., Fu, S., Zhao, J., Hecht, B., Konstan, J., Terveen, L., Yarosh, S. and Zhu, H. 2019. Teaching UI design at global scales: A case study of the design of collaborative capstone projects for MOOCs. In: Proceedings of the 6th 2019 ACM Conference on Learning at Scale, L@S 2019.

Cho, M.-H. and Byun, M.-K. 2017. Nonnative English-Speaking students’ lived learning experiences with MOOCs in a regular college classroom. International Review of Research in Open and Distance Learning, 18(5), pp. 173–190.

Cisel, M. 2018. Interactions in MOOCs: the hidden part of the iceberg. International Review of Research in Open and Distance Learning, 19(5), pp. 81–94.

Dalipi, F., Imran, A. S. and Kastrati, Z. 2018. MOOC dropout prediction using machine learning techniques: review and research challenges. IEEE Global Engineering Education Conference, EDUCON, pp. 1007–1014.

Dhawal, S. 2020. The Second Year of the MOOC: A Review of MOOC stats and Trends in 2020, [online]. Available from [Accessed 10 August 2021].

Edinburgh Group. 2013. A Report Summarising the Experience of the University of Edinburgh of Offering Our First 6 Massive Open Online Courses (MOOCs) in Partnership with Coursera. Available from [Accessed 10 August 2021]

Evans, B., Baker, R. and Dee, T. 2016. Persistence patterns in massive open online courses (MOOCs). The Journal of Higher Education, 87(2), pp. 206–242.

Evans, T., Kensington-Miller, B. and Novak, J. 2021. Effectiveness, efficiency, engagement: Mapping the impact of pre-lecture quizzes on educational exchange. Australasian Journal of Educational Technology, 37(1), pp. 163–177. Available from

Fyfield, M., Henderson, M., Heinrich, E. and Redmond, P. 2019. Videos in higher education: Making the most of a good thing. Australasian Journal of Educational Technology, 35(5), pp. 1–7. Available from

Garrison, D. R. and Anderson, T. 2003. E-learning in the 21st century: a framework for research and practice. In: Open Universiteit Nederland, pp. 49–70.

Garrison, D. R. Anderson, T. and Archer, W. 2000. Critical inquiry in a text-based environment: Computer conferencing in higher education. Internet and Higher Education, 2(2-3), pp. 87–105.

Ghosh, R., Haynes, R. K. and Kram, K. E. 2013. Developmental networks at work: Holding environments for leader development. Career Development International, 18(3), pp. 232–256.

Guo, P. J., Kim, J. and Rubin, R. 2014. How video production affects student engagement: an empirical study of MOOC videos. First ACM Conference on Learning @ Scale, pp. 41–50.

Hausman, D. M. and Welch, B. 2010. Debate: To nudge or not to nudge. Journal of Political Philosophy, 18(1), pp. 123–136.

Hew, K. F. 2015. Towards a model of engaging online students: Lessons from MOOCs and four policy documents. International Journal of Information and Education Technology, 5(6), pp. 425–431.

Hone, K. and El Said, G. 2016. Exploring the factors affecting MOOC retention: a survey study. Computers and Education, 98, pp. 157–168.

Jordan, K. 2015. Massive open online course completion rates revisited: assessment, length and attrition. International Review of Research in Open and Distributed Learning, 16(3), pp. 341–358.

Kahn, W. A. 2001. Holding environments at work. The Journal of Applied Behavioral Science, 37(3), pp. 260–279.

Kilgore, W. and Lowenthal, P. R. 2015. The human element MOOC: an experiment in social presence. In: Wright, R. D. (Ed.), Establishing an Equitable and Fair Admissions System for an Online Doctoral Program, IGI Global, pp. 389–407.

Kizilcec, R. F., Schneider, E., Cohen, G. L. and McFarland, D. A. 2014. Encouraging forum participation in online courses with collectivist, individualist and neutral motivational framings. eLearning Papers, 37, pp 13–21.

Kopolovich, O. 2020. Learning soft skills in the digital age: Challenges and insights from development and teaching 'Negotiation Management' MOOC. The Online Journal of Applied Knowledge Management (OJAKM), 8(2), pp. 91–106.

Lee, Y. and Choi, J. 2011. A review of online course dropout research: implications for practice and future research. Educational Technology Research and Development, 59(5), pp. 593–618.

Lee, J. and Martin, L. 2017. Investigating students’ perceptions of motivating factors of online class discussions. International Review of Research in Open and Distance Learning, 18(5), pp. 149–172.

Min, L. and Jingyan, L. 2017. Assessing the effectiveness of self-regulated learning in MOOCs using macro-level behavioural sequence data. CEUR Workshop Proceedings, pp. 1–9.

Mohamed, A., Yousef, F., Chatti, M. A., Schroeder, U. and Wosnitza, M. 2015. A usability evaluation of a blended MOOC environment: an experimental case study. The International Review of Research in Open and Distributed Learning, 16(2), pp. 69–93.

Padilla Rodriguez, B. C. and Armellini, A. 2015. Expanding the interaction equivalency theorem. International Review of Research in Open and Distance Learning, 16(3), pp. 298–317.

Rabin, E., Henderikx, M., Kalman, Y. M. and Kalz, M. 2020. What are the barriers to learners’ satisfaction in MOOCs and what predicts them? The role of age, intention, self-regulation, self-efficacy and motivation. Australasian Journal of Educational Technology, 36(3), pp. 119–131.

Reich, J. 2014. MOOC completion and retention in the context of student intent. Educause Review. Available from [Accessed 10 August 2021].

Reich, J. and Ruipérez-Valiente, J. A. 2019. The MOOC pivot. Science, 363(6423), pp. 130–131.

Schuwer, R., Gil-Jaurena, I., Aydin, C. H., Costello, E., Dalsgaard, C., Brown, M., Jansen, D. and Teixeira, A. 2015. Opportunities and threats of the MOOC movement for higher education: The European perspective. International Review of Research in Open and Distance Learning, 16(6), pp. 20–38.

Soffer, T. and Cohen, A. 2015. Implementation of Tel Aviv university MOOCs in academic curriculum: A pilot study. International Review of Research in Open and Distance Learning, 16(1), pp. 80–97.

Spiro, R. J. and Jehng, J. C. 1990. Cognition, education, and multimedia: exploring ideas in high technology. In: Nix, D. and Spiro, R. (Eds.), Cognition, Education, and Multimedia: Exploring Ideas in High Technology, Lawrence Erlbaum Associates, pp. 163–205.

Teusner, R., Hille, T. and Staubitz, T. 2018. Effects of automated interventions in programming assignments: evidence from a field experiment. In: Proceedings of the 5th Annual ACM Conference on Learning at Scale, L@S 2018, pp. 1–10.

Thaler, R. H. and Sunstein, C. R. 2008. Nudge: improving decisions about health, wealth, and happiness. New Haven and London: Yale University Press.

Van Buskirk, W. and McGrath, D. 1999. Organizational cultures as holding environments: a psychodynamic look at organizational symbolism. Human Relations, 52(6), pp. 805–832.

Winnicott, D. W. 1982. Playing and reality. London and New York: Routledge Classics.



31 Mar 2022