Evaluation of the MOOCs Quality and Its Effectiveness for Teachers’ Training in the Field of Digital Competences and Their Use in Education: A Case Study

Eugenia Smyrnova-Trybulska; Iryna Sekret; Nataliia Morze; Elspeth McKay

doi:10.31261/IJREL.2022.8.1.03

Published: 2022-06-16

Vol. 8 No. 1 (2022)

Evaluation of the MOOCs Quality and Its Effectiveness for Teachers’ Training in the Field of Digital Competences and Their Use in Education: A Case Study

Eugenia Smyrnova-Trybulska

, Iryna Sekret

, Nataliia Morze

, Elspeth McKay

Section: Articles

https://doi.org/10.31261/IJREL.2022.8.1.03

Abstract

This study presents the research results obtained after the assessment of the digital competences of the pre-service and in-service teachers after their completion of the MOOC “Contemporary ICT Tools and Innovative Methods of Creative Education”. The paper provides a short description of the MOOC, requirements to pass the course and analysis of the learning outcomes through the students’ self-evaluation and feedback. The MOOC was developed in Polish and English within the project “MOOCs for Sciences of Education” and hosted on the Polish MOOCs platform Navoica (www.navoica.pl) within the framework of the competition, initiated by of Ministry of Education and Science of Poland and National Center for Research and Development (NCBR ‒ Narodowe Centrum Badań i Rozwoju) on “Direction to the MOOC”. Keeping in mind that Massive Open Online Courses (MOOCs) have developed into a mainstream for universities, education reformers and startup companies, especially in the time of the COVID-19, the study is believed to contribute to the development of the MOOC pedagogy, and address the question of the MOOCs effectiveness for students’ learning outcomes and satisfaction. The experimental MOOC “Contemporary ICT Tools and Innovative Methods of Creative Education”, which was aimed at enhancing teachers’ digital competences, contained 8 modules, and was attended by more than 90 students through its 1st edition in 2020‒2021. The conclusions of the MOOC in focus and overall recommendations on enhancing the MOOCs effectiveness for formal education and learning outcomes have been evaluated based on the research data and provided accordingly. The selected statistical analyses and the data comparisons were made using Wilcoxon’s test at the significance level alpha = 0.05. The normality of the distributions of the studied variables was checked using the Shapiro Wilk test.

Keywords:

MOOCs , education , digital competences , teachers , ICT-tools in education

Download files

PDF

Citation rules

Smyrnova-Trybulska, E., Sekret, I., Morze, N., & McKay, E. (2022). Evaluation of the MOOCs Quality and Its Effectiveness for Teachers’ Training in the Field of Digital Competences and Their Use in Education: A Case Study. International Journal of Research in E-Learning, 8(1), 1–34. https://doi.org/10.31261/IJREL.2022.8.1.03

Cited by / Share

References

Aldahmani, S., Ali Al-shami, S., Adil, H., & Sidek, S., (2020) A Review Paper on MOOCs Development Stages, Types, and Opportunities and Challenges. Systematic Reviews in Pharmacy, 2020; 11(12): 172‒179, https://doi.org/10.31838/srp.2020.12.28
Google Scholar

Cabero-Almenara J, Gutiérrez-Castillo J-J, Palacios-Rodríguez A, & Barroso-Osuna J. (2020) Development of the Teacher Digital Competence Validation of DigCompEdu Check-In Questionnaire in the University Context of Andalusia (Spain). Sustainability. 2020; 12(15):6094. https://doi.org/10.3390/su12156094
Google Scholar

Cabero-Almenara, J., Romero-Tena, R., & Palacios-Rodriguez, A. (2020). Evaluation of Teacher Digital Competence Frameworks Through Expert Judgement: the Use of the Expert Competence Coefficient. Journal of New Approaches in Educational Research, 9(2), 275‒293, https://doi.org/10.7821/naer.2020.7.578
Google Scholar

Condruz-Bacescu, M. (2018) Free Online Education - The Future of a Better World? In Roceanu I., Topor, S., Holotescu, C., Radu, C., Nitu, F., Grosseck, G., Radoi, M. (Eds.) Elearning Challenges and New Horizons, (pp. 303‒310) https://doi.org/10.12753/2066-026X-18-257
Google Scholar

Cong, R., Tago, K. & Jin, Q. (2022) Measurement and verification of cognitive load in multimedia presentation using an eye tracker. Multimedia Tools and Applications 6(7), 1‒15, https://doi.org/10.1007/s11042-022-13294-0
Google Scholar

Cross, J. S., Keerativoranan, N., Carlon, M. K. J., Tan, Y. H. Rakhimberdina, Z. & Mori, H., (2019) Improving MOOC quality using learning analytics and tools, 2019 IEEE Learning With MOOCS (LWMOOCS), 2019, (pp. 174-179), http://doi.org/ 10.1109/LWMOOCS47620.2019.8939617.
Google Scholar

Deng, R., Benckendorff, P., & Gannaway, D. (2019). Progress and new directions for teaching and learning in MOOCs. Computers & Education 129, 48–60, https://doi.org/10.1016/j.compedu.2018.10.019
Google Scholar

Deterding, S., (2011). Situated motivational affordances of game elements: A conceptual model, in: Presented at Gamification: Using Game Design Elements in Non-Gaming Contexts, a workshop at CHI 2011. http://gamification-research.org/wp-content/uploads/2011/04/09-Deterding.pdf (Accessed 28 October 2015).
Google Scholar

Gordillo A., López-Pernas S., & Barra E. (2019). Effectiveness of MOOCs for teachers in safe ICT use training. Comunicar. Open Access. 27(61), 98-107, 2019. ISSN 11343478, https://doi.org/10.3916/C61-2019-09
Google Scholar

Grodecka, K., Mokwa-Tarnowska, I., & Peszko, P. (2019). Praca zbiorowa NAVOICA Polska platforma edukacyjna oferująca kursy typu MOOC Wytyczne dla twórców kursów. A. Kaczmarek-Kacprzak, K. Kurowska-Wilczyńska, B. Muczyński (red.) [Warszawa 2019 NAVOICA Polish educational platform offering MOOCs Guidelines for course developers.] Wydawnictwo Fundacja Młodej Nauki, Warszawa 2020.
Google Scholar

Kameas, A., Quarta, B. & Maratou, V. (2018) Educating Global Citizens with the Help of a MOOC, EDULEARN18 Proceedings, pp. 10933‒10942.
Google Scholar

Kim, D. & Choi, M. (2022) Impacts of Device Caching of Content Fractions on Expected Content Quality, in IEEE Wireless Communications Letters, 11(5), (pp. 1022‒1026), May 2022, htttp://doi.org/10.1109/LWC.2022.3153125.
Google Scholar

Koukis N., & Jimoyiannis A., (2018) MOOCs and teacher professional development: A case study on teachers’ views and perceptions MCCSIS 2018 ‒ Multi Conference on Computer Science and Information Systems In Proceedings of the International Conferences on e-Learning 2018 Volume 2018-July, (pp. 19–26) International Conference e-Learning 2018, part of the Multi Conference on Computer Science and Information Systems 2018, MCCSIS 2018 Madrid 17 July 2018 through 19 July 2018 Code 912893820 ISBN 978-989853378-4
Google Scholar

Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768.
Google Scholar

Majuri, J., Koivisto, J., & Hamari, J. (2018) Gamification of education and learning: A review of empirical literature In Proceedings of the 2nd International GamiFIN Conference (GamiFIN 2018) (pp. 11‒19). Eds. by Koivisto J. & Hamari J. CEUR Workshop Proceedings. 2186. CEURWS. ISSN: 1613‒0073. http://ceur-ws.org/Vol-2186/paper2.pdf. https://trepo.tuni.fi/bitstream/handle/10024/104598/gamification_of_education_2018.pdf
Google Scholar

Molanes-Lopez, E.M., Rodriguez-Ascaso, A., Leton E., & Perez-Martin, J. (2021) Assessment of Video Accessibility by Students of a MOOC on Digital Materials for All IEEE Access Open Access. 9, (pp. 72357–72367) Article number 9427559, https://doi.org/10.1109/ACCESS.2021.3079199, ISSN 21693536
Google Scholar

Morze, N. & Smyrnova-Trybulska, E. (2021) Web-Based Community-Supported Online Education During the COVID-19 Pandemic. International Journal of Web Based Communities (IJWBC) 17(1), 9–34 http://doi.org/10.1504/IJWBC.2021.10032201
Google Scholar

Patru, M., & Balaji, V. (2016) Making sense of MOOCS: a guide for policy makers in developing countries (2016) Commonwealth of Learning, UNESCO. Assistant Director-General for Education, 2010-2018 (Qian Tang). ISBN: 978-92-3-100157-4 2016
Google Scholar

Polish MOOCs platform Navoica (www.navoica.pl).
Google Scholar

Razzali, K. K. S., Shahbodin, F., & Noor, H. (2016). Measuring validity and reliability of perception of online collaborative learning questionnaire using Rasch model. International Journal on Advanced Science Engineering and Information Technology, December, 966-974. http://dx.doi.org/10.18517/ijaseit.6.6.1343
Google Scholar

Seaborn, K., & Fels, D. I. (2014). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14–31.
Google Scholar

Sebai, D. & Mani, E. (2020) MPEG-DASH users quality of experience enhancement for MOOC videos, 2020 IEEE International Symposium on Multimedia (ISM), 2020, pp. 166-167, https://doi.org/10.1109/ISM.2020.00036.
Google Scholar

Segovia García, N. (2021) Quality criteria of a Massive Open Online Course (MOOC) based on students’ assessment [Critères de qualité d’un MOOC basés sur l’évaluation des étudiants][Criterios De Calidad De Un MOOC Basado En La Valoración De Los Estudiantes]. Bordon. Revista de Pedagogia 73(4), 145–160 https://doi.org/10.13042/Bordon.2021.87938, ISSN 02105934
Google Scholar

Sekret, I. (2021). Students’ Evaluation of Teaching: International Practices from the Students’ Perspectives. International Journal of Pedagogical Advances in Technology-Mediated Education, 2 (1), 26‒38. ISSN 2651-4427. http://patme-journal.iatels.com/index.php/patme/article/view/students-evaluation-of-teaching
Google Scholar

Sekret, I., & Jansen, D. (2019). Multilevel Study of the Higher Education Challenges Caused by the Migration Crisis in Turkey. In: Smyrnova-Trybulska, E., Kommers, P., Morze, N., Malach, J. (eds) Universities in the Networked Society. Critical Studies of Education, vol. 10. Springer, Cham. https://doi.org/10.1007/978-3-030-05026-9_9
Google Scholar

Smyrnova-Trybulska E., Morze, N., Sekret, I. McKay, E., & Asquith, K., (2022) Development of the digital competences of pre-service and in-service teachers using the MOOC: Rasch Measurement Model in Assessing. (In Press)
Google Scholar

Smyrnova-Trybulska E., Sekret, I., & Morze, N. (2021) Preliminary Analysis of the Development And Implementation of the MOOC Project: A Case Study, In Smyrnova-Trybulska E. (ed.) E-learning in the Time of COVID-19. “E-learning” Series. Vol. 13 (2021) Katowice-Cieszyn: STUDIO NOA for University of Silesia. 2021. (pp. 137‒150). ISSN 2451-3644 (print edition) ISSN 2451-3652 (digital edition) ISBN: 978-83-66055-25-4 https://doi.org/10.34916/el.2021.13.12
Google Scholar

Smyrnova-Trybulska, E., McKay, E., Morze, N., Yakovleva, O., Issa, T. & Issa, Th. (2019). Develop and Implement MOOCs Unit: a Pedagogical Instruction for Academics, Case Study In: E. Smyrnova-Trybulska, P. Kommers, N. Morze, J. Malach (Eds.). Universities in the Networked Society. Cultural Diversity and Digital Competences in Learning Communities. Springer. Critical Studies of Education 10 (pp. 103–132), ISBN 978-3-030-05025-2, https://doi.org/10.1007/978-3-030-05026-9_7.
Google Scholar

Smyrnova-Trybulska, E., Ogrodzka-Mazur, E., Szafrańska-Gajdzica, A., Morze, N., Makhachashvili, R., Noskova, T., Pavlova, T., Yakovleva, O., Issa, T. & Issa, Th. (2016). MOOCs – Theoretical and Practical Aspects: Comparison Of Selected Research Results: Poland, Russia, Ukraine, and Australia. In: P. Kommers, T., Issa, Th. Issa, E., McKay, & P., Isaías. Proceedings Of The International Conferences On Internet Technologies & Society 2016 (ITS 2016) Educational Technologies 2016 (IcEduTech 2016) And Sustainability, Technology And Education 2016 (STE 2016) Melbourne, Australia 6–8 December, IADIS 2016 (pp. 107–114). ISBN: 978-989-8533-58-6.
Google Scholar

Stracke, C.M., & Trisolini, G. A (2021) Systematic Literature Review on the Quality of MOOCs. Sustainability, 13, 5817. https://doi.org/10.3390/su13115817
Google Scholar

Su, P.-Y., Guo, J.-H., & Shao, Q.-G. (2021) Construction of the Quality Evaluation Index System of MOOC Platforms Based on the User Perspective. Sustainability, 13, 11163. https://doi.org/10.3390/su132011163
Google Scholar

Svoboda, P., & Mynaříková, L. (2021). MOOC Courses as a Tool for the Development of Digital Competencies of Teachers. In: Nazir, S., Ahram, T.Z., Karwowski, W. (eds) Advances in Human Factors in Training, Education, and Learning Sciences. AHFE 2021. Lecture Notes in Networks and Systems, vol 269. Springer, Cham. https://doi.org/10.1007/978-3-030-80000-0_29
Google Scholar

Werbach, K., & Hunter, D. (2015) The Gamification Toolkit: Dynamics, Mechanics, and Components for the Win. Wharton School Press https://wsp.wharton.upenn.edu/book/gamificationtoolkit/
Google Scholar

Yu, B., & Zadorozhnyy, A. (2022). Developing students’ linguistic and digital literacy skills through the use of multimedia presentations. ReCALL, 34(1), 95-109. doi:10.1017/S0958344021000136
Google Scholar

Vol. 8 No. 1 (2022)
Published: 2022-09-15

ISSN: 2451-2583

eISSN: 2543-6155

Publisher

Wydawnictwo Uniwersytetu Śląskiego | University of Silesia Press

Submit