Examining the External Effectiveness Components of E-Learning to Provide a Framework for Developing Qualitative Change in Higher Education

Torkzadeh, J.; Ahangari, M.; Mohammadi, M.; Marzooghi, R.; Hashemi, S.

doi:10.22061/tej.2021.5913.2322

Document Type : Original Research Paper

Authors

¹ Educational Management Department, Faculty of Education and Psychology, Shiraz University. Shiraz, Iran

² Computer Department, Faculty of Computer Engineering, Shiraz University. Shiraz, Iran

https://doi.org/10.22061/tej.2021.5913.2322

Abstract

Background and Objectives: Improving and enhancing the quality and effectiveness of e-learning in the universities require examining and recognizing the internal and external factors affecting it. To this end, certain models and frameworks have been developed to evaluate the effectiveness of the e-learning system. However, the diversity of the dimensions of the effectiveness system in the literature and the multiplicity of the models not only implies a theoretical gap in this area but also it has challenged the operational and technical scopes of the issues. The purpose of this qualitative study is investigating and analyzing the external effectiveness components of e-learning in order to make a qualitative change in higher education system.
Methods: In this study, it was attempted to thoroughly identify the components of evaluating the effectiveness of academic e-courses with a qualitative approach. The research method is qualitative, and in particular "qualitative case study”. Thus, the potential contributors to this study included all faculty members of Virtual Colleges of Shiraz Universities, Payam Noor, and Allameh Tabatabai University virtual education instructors and a number of content development specialists and educational designers (n = 25) who were selected based on purposeful sampling in terms of criteria (expertise and experience) and considering data saturation, In line with the aforementioned purpose, an interview was conducted with 25 experts in this field. Then, the obtained data were analyzed through the content analysis technique.
Findings: In order to achieve this, by studying the models of blended and related exploratory learning and interviewing the experts and skillful professors of this field and analyzing the data extracted from such interviews, reviewing the documents, theoretical foundations, and research backgrounds of e-learning in the universities of the developed countries and Iran, the researcher has highlighted the influence that external effective evaluation components have on e-learning as an organizing content including twelve major themes with the following titles to be significant and necessary in the education system: economizing and increasing productivity; the dynamics and flexibility related to the new educational developments and technologies; cultivation of organizational e-learning; competitiveness of the products; training and employment of human resources specialized in e-learning; identifying and responding to environmental needs; lifelong learning; realization of patterns of competence; realizing the goals and excellence of the beneficiary organization; promotion of professional capabilities in the workplace; strengthening technical and vocational education; and success, effectiveness, and competitiveness of the learners. The results were validated using data matching method, the validity, the reliability and reliability of the research data. In the next step, the researcher used content validity index (CVI) to determine the relevance and necessity of themes and the extracted organizing theme. The validity and reliability criteria were used to validate the framework. Four criteria for adaptation, intelligibility, generalizability and control were used to determine the acceptability of the proposed framework. Certainly, knowledge of these components can be necessary and reliable in properly evaluating the overall effectiveness of the e-learning courses.
Conclusion: After summing up the findings of this study, it is shown that evaluating the effectiveness of e-learning is a comprehensive cycle that is not just limited to evaluating the effectiveness of what is done within the e-learning system. Rather, it should be seen whether the e-learning system has been able to respond to the needs of the society and to fulfill the mission intended for the organization or not. In this study, 12 components were identified to evaluate the external effectiveness of the university e-learning system, and the study and evaluation of each of these components can indicate different dimensions of the external effectiveness of e-learning. Also, the interaction between external and internal levels of e-learning effectiveness and the interaction between the two levels were investigated and analyzed. The limitations of the present study were that the findings were not collected in the field and in the operational scene, and that there were no similar comprehensive samples to be further compared and studied.

Keywords

20.1001.1.20080441.1401.16.2.1.5

Main Subjects

e-learning

COPYRIGHTS
©2022 The author(s). This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.

References

[1] Torkzadeh J, Ahmadvand A.M. [An applied model for the strategic leading of information system in universities]. Higher Education letter. 2010;2(6):121-140. [Persian].

[2] Torkzadeh J, Keshvriz F. [The effectiveness of medical education curriculum: Internal, external and institutional]. Educational Development of Jundishapour. 2016; 7(1): 10-21. [Persian].

[3] E Hug S, Ochsner M, Daniel H-D. Criteria for assessing research quality in the humanities—A Delphi study among scholars of English literature, German literature and art history. Research Evaluation. 2013; 22(5): 369–383.

[4] Torkzade J, Majidi A, Noormohammadi H. Assessment of the external effectiveness of non-commissioned officers' training Active in law enforcement Job groups. Journal Management System. 2009; 4(4):461-481. [Persian].

[5] Montazer Gholam A. Strategic studies on information development of higher education system in Iran. Research and Planning in Higher Education. 2007; 13(1) (43): 1-26.

[6] Yazdani F. Types of e-learning and different forms of interaction in it. Paper presented in the 4th national conference and the first international conference on e-learning. Tehran: 2009.

[7] Turkzadeh J, Mohammadi M, Qasemi Qasmvand M.R. Evaluation of internal, external and institutional effectiveness of education system in Arvand Petrochemical Company. Humanities and Arts.2005; 4: 125-140.

[8] Khorasani A, Doosti H. A study of the Level of Satisfaction and Importance of the Factors Influential on Effectiveness of E-Learning from the Employees’ Viewpoints. Information and Communication Technology in Educational Sciences. 2011; 1(4): 37-58.

[9] Yamani Dozi Sorkhabi M. Introduction to the study of the performance of university systems. Tehran: Shahid Beheshti University Press; 2002. Persian.

[10] Parkes M, Stein S. Reading C. Student preparedness for university e-learning environments. The Internet and Higher Education. 2015; 25: 1-10. ‏

[11] Gaebel M, Kupriyanova V, Morais R, Colucci E. E-learning in European higher education institutions: Results of a mapping survey conducted in October-December 2013. Brussels: European University Association Publications;2015. ‏

[12] Hmelo-Silver, Cindy E. Problem–based learning: What and how do students learn. Educational Psychology Review. 2004; 16(3):235-266.

[13] Garrison R. E-learning in 21^st century: A framework for research and practice.2011; UK: Routledge

[14] Negash S, Whitman M, Woszczynski A.B, Hoganson K , Mattord H. Handbook of Distance learning for real-time and asynchronous information technology education. US: Information Science Reference. 2008.

[15] Zarif sanayei, N. Provide a conceptual model of effective distance learning in higher education. [Dissertation]. Tehran: Payame Noor University of Tehran;2011.

[16] Torkzadeh J, Mohammadi M, Sutoodehfar S. [Developing and validating of the teaching-learning comprehensive system in higher education]. Journal of Curriculum Research. 2015; 4(2): 93-116. Persian.

[17] Torkzadeh J, Sotoudeh Far S. Provide an explanatory framework for the dimension of teaching-learning process as a comprehensive behavioral system. Journal of Management on Disciplinary Education. 2014; 1393 (28): 89-113.

[18] Bazgan.A, Educational evaluation: Concepts, patterns and operational process. Tehran: Samt Publication; 2014.Persian.

[19] Mohammadi A, Mojtahedzadeh R. [Eraeye barnamehaye amoozeshe modavem jameaye pezeshki az tarighe internet]. First Conference of e-learning in medical education; Tehran: Tehran University of Medical Sciences; 2007. Persian.

[20] Lara A, David L, María A, MartínezaJuan P. A system for knowledge discovery in e-learning environments within the European Higher Education Area – Application to student data from Open University of Madrid, UDIMA. Computers & Education. 2014; 72: 23-36

[21] Islam N. Investigating e-learning system usage outcomes in the university context. Computers & Education.2013; 69: 387-399.

[22] Salehi Imran A, Salari Z. Combined Learning; A new approach in the development of education and the teaching-learning process. Education Strategy Medical Science .2012; 5(1): 69-75.

[23] Abazari Z, Mirjani Aghdam A, Cheraghi A. Factors affecting students' participation in the teaching-learning process from the perspective of teachers. Rehabilitation Journal. 2005; 16(3): 262-269.

[24] Shabani V.B, Ahanchian N. Academic leadership and social capital: A sociological approach to higher education management. New educational Ideas.2006;1(3):39-58

[25] Saeedi Siouki M, Gholizadeh H. A look at the role of information and communication technology in the teaching-learning process with emphasis on the constructivist approach. Paper presented in the 4^th Conference of the Iranian Philosophy of Education Association: 2013 May 29: Iran.

[26] Zolfaghari M, Mehrmohamadi M. [Student’s evaluation of the quality of teaching of university profession teaching human science in Tehran universities]. Daneshvar Raftar.2004; 11(6): 17-28. Persian.

[27] Myers B.E, Washburn S.G, Dyer J.E. Assessing agriculture teachers’ capacity for teaching science integrated process skills. Journal of Southern Agricultural Education Research. 2004; 54(1): 74-85.

[28] Mousavi A, Mares C, Stonham TJ. Continuous feedback loop for adaptive teaching and learning process using student surveys. International Journal of Mechanical Engineering Education. 2015; 43(4): 247-264.

[29] Kumar S, Bhardwaj GN. Effective teaching and Learning process through project-based Learning (PBL). In MOOCs, Innovation and Technology in Education (MITE), 2015 IEEE 3rd International Conference on2015 (pp. 325-330). IEEE.

[30] Svensson. M, Ingerman, Å., & Berglund, A. (2015). Teaching and learning system thinking in technology. 29^th PATT conference proceedings Plurality and Complementarity of Approaches in Design and Technology Education: 2015 Apr: Marseille, France.

[31] Kaspeavičiūtė R. Application of ISO 9001 and EFQM Excellence odel within higher education institutions: Practical experiences analysis. Social Transformations in Contemporary Society. 2013; 1: 81-92.

[32] Kia A.A. [A look at virtual education (Electronic)]. Faculty of Social Sciences Allameh Tabatabaei University Social Science Book. 2009; 138(24): 82-89

[33] Torkzadeh J, Ansari S. [Developing and accreditation of a framework for evaluation university manager’s competencies, based on Islamic teachings]. Management in Islamic University. 2015; 4(1 (9)):3-22. Persian.

[34] Torkzadeh J, avarzi. F. The Effectiveness of medical education curriculum: Internal, external and institutional. Educational Development of Jundishapur. 2016;7(1):10-21.

[35] Seraj F, Hosseini H, Sarv Dalir A. Determining the criteria for measuring the effectiveness of seminary virtual education courses. Journal of Theory and Practice in Curriculum. 2013; 1(1): 73-100.

[36] Clark R.C, Mayer R.E. E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. US: John Wiley & Son. 2016. ‏

[37] Tasdighi M.A, Tasdighi F. Pathology of virtual and electronic education on the horizon of Iran, 1404. Paper presented in the 1^st National Conference on Education in Iran 1404; 2011: Tehran, Iran.

[38] Olson M.H. An Introduction to Theories of Learning. UK: Routledge.2015.

[39] Chiero, R, Beare P, Marshall J, Torgerson C. Evaluating the effectiveness of e-learning in teacher preparation. Educational Media International. 2015; 52(3): 188-200. ‏

[40] Hsbollah H.M, Idris K.M. E-Learning Adoption: The Role of Relative Advantages, Triability and Academic Specialization. Wide Information Systems. 2009; 26: 54-70.

[41] Rezaei rad M. [Identifying the success factors in e- learning programs]. Research in Curriculum Planning. 2012; 9(33): 106-115.Persian.

[42] Mohammadi Khyareh M, Rostami N. [Investigating the relationship between entrepreneurship, competitiveness and economic development]. Technology Development. 2019; 15(57): 14-23. Persian.

[43] Rezazadeh A, Hoseininasab S.D, Sarmadi M, Farjollahi M. [Assess and prioritizing affecting factors on quality of education in e-learning environments using analytical hierarchy process method]. Journal of Educational Sciences. 2018; 11(41):115-134. Persian.

[44] Field J. Lifelong learning and the new educational order. London: Trentham Books; 2000.