Mathematics in the Digital Age: Examining the Role of the Evaluation Protocol in E-Learning for Student Learning

Paseban-khamari, Kh.; Rabiei, M. R.; Shahvarani-Semnani, A.; Rostamy Mal-khalifeh, M.

doi:10.22061/tej.2025.11405.3147

Articles in Press

Document Type : Original Research Paper

Authors

¹ Department of Mathematics and Computer Science, Faculty of Converging Sciences and Technologies, Science and Research Branch, Islamic Azad University, Tehran, Iran

² Department of Statistics, Faculty of Mathematical Sciences, Shahrood University of Technology, Shahrood, Iran

https://doi.org/10.22061/tej.2025.11405.3147

Abstract

Background and Objectives: The outbreak of the COVID-19 pandemic and the sudden expansion of virtual education have created unprecedented challenges in educational systems, particularly in the area of effective and accurate assessment. Assessment is a key element in the learning process that directly impacts the quality of teaching and student learning. In this context, the decline in learning levels, especially in mathematics, has become a significant issue in education. This research investigates the impact of implementing a designed electronic assessment protocol on students' learning in mathematics. The main research question was whether implementing the electronic assessment protocol can help improve students' mathematics learning.
Methods: This research was experimental-empirical. The experimental group was influenced by the independent variable (implementation of the electronic education evaluation protocol), while the control group did not experience this intervention. The dependent variable was the academic progress of students in mathematics. Confounding factors, including educational level and type of school (gifted, witness, and regular), were also considered in the statistical model. The statistical population included all female middle school students in Golestan Province during the 2020-2021 academic year. A sample of 204 students (experimental group) was selected using multi-stage cluster sampling. To compare and control, 379 female middle school students (control group) were selected in proportion to the type of school. In the first stage, the electronic content for the mathematics lesson was designed and produced by the participating teachers. Additionally, a training workshop was held for the teachers to educate them on evaluation concepts and to develop an operational protocol in the virtual learning environment. In the second stage, the protocol was implemented in both experimental and control groups, and its effectiveness was assessed. For data analysis, descriptive statistics (mean, variance, etc.) and inferential statistical tests (analysis of covariance and multivariate and univariate tests) were utilized using SPSS software version 27.
Findings: The results showed that there was a significant difference in the academic progress of students in the experimental and control groups after the implementation of the e-learning evaluation protocol. In other words, the implementation of the protocol led to a significant increase in the academic progress of the students. Additionally, a significant effect of educational level on the academic progress of students was observed. The type of school also has a significant impact on the academic progress of students.
Conclusion: The findings of this research confirmed the effectiveness of the electronic evaluation protocol in improving students' mathematics learning. Utilizing evaluation strategies that align with educational objectives and course content, along with the implementation of integrated evaluation methods instead of relying on a single approach, can enhance the credibility of assessments and improve students' academic progress. These findings offer suggestions for designing and implementing more effective evaluation systems in electronic education. The execution of the electronic evaluation protocol not only increases the accuracy and reliability of assessments but also plays a significant role in enhancing the quality of education by motivating and encouraging students to learn. Integrated evaluation methods, by providing precise and reliable feedback, can assist teachers in identifying students' strengths and weaknesses and adjusting their educational programs based on their actual needs. Therefore, it is recommended that educational systems adopt electronic and integrated evaluation methods to improve the learning process and prepare students for future challenges.

Keywords

Main Subjects

Education technology - Evaluation and testing

COPYRIGHTS
© 2024 The Author(s). This is an open-access article distributed under the terms and conditions of the Creative Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) (https://creativecommons.org/licenses/by-nc/4.0/)

References

[1] Zuber M.M, Sulaiman H. Exploring the effectiveness of e-learning in increasing students’ achievements in mathematics at the primary school level. 2019; AIP Conf. Proc. 2184, 30004. https://doi.org/10.1063/1.5136372.

[2] Hiong S.N, Agatha F.U. A Pilot Study on Factors Affecting the Use of Frog Virtual Learning Environment. 2015; Jurnal Penyelidikan IPG KBL Jilid, 12: 1–17.

[3] Hatami J, Mohammadi R. [Designing the National Organization for Evaluation, Accreditation and Quality Assurance of Higher Education]. Journal of Measurement & Educational Evaluation Studies. 2013; 3(3): 145-174. [In Persian]

[4] Farhangi A, Yazdani H, Haghshenas M. [Identication of learning management systems functional areas and limitations case study: elearning center of university of Tehran]. Journal of information technology management. 2018; 10(2): 331-354. [In Persian]

[5] Moore M.G, Kearsley G. Distance Education: A Systems View of Online Learning. What's New in Education. Cengage Learning. (2011). ISBN 978-1-111-52099-1

[6] Almassi Jazi Z, Enteshari Sh, Ebdali N. Virtual education and the investigation of effective teaching methods in the teaching and learning process. 13th National Education Conference, Tehran: 2020 March 12. [In Persian]

[7] Gafoor K, Kurukan A. Why High School Students Feel Mathematics Difficult? An Exploration of Affective Beliefs. in UGC Sponsored National Seminar on Pedagogy of Teacher Education, Trends and Challenges.2015; (Farook Training College, Kozhikode, Kerala, 2015).

[8] Azimpour S, Vahed H. [The effect of electronic educational media on academic progress and academic selfefficacy in geometry]. Journal of Technology of Education.2023; 17(4): 811-824. [In Persian]

https://doi.org/10.22061/tej.2023.9760.2896.

[9] Faramarzi H, Behrozi N, Farzadi F. [The relationship between Antecedents of Academic Emotions, Identity, Education and Academic Achievement Goals]. Journal of school psychology. 2019; 8(2): 91-112. [In Persian]

https://doi.org/10.22098/jsp.2019.815.

[10] Karimi S, Nasr A.R, Boghratian K. [Lifelong Learning: The Approach of University in 21st Century]. Isfahan: University of Isfahan and Samt; 2009. [In Persian]

[11] Saif A.A. Measurement, assessment and evaluation of education. Tehran: Duran Publishing; 2018. [In Persian]

[12] Woolfalk A.E. Educational Psychology (9^th Ed). Englewood cliffe, NJ: Prentice-Hall. (2004).

[13] Abbasi Kasani H, Shams Mourkani G, Seraji F, Rezaeizadeh M. [Evaluation in e-learning: what, why, how]. Development Strategies in Medical Education. 2021; 8(1): 80-91. 10.52547/dsme.8.1.80 [In Persian]

[14] Abbasi Kasani H, Haji Zeynalabdini M, Raisi A. [Pathology of University of Medical Sciences E-learning System based on Khan Model]. Journal of Medical Education and Development (JMED). 2018; 12(4): 227-238. URL: [In Persian]

[15] Abbasi Kasani H, Shams Mourkani G, Seraji F. [Solutions to Improve Formative Assessment in E-learning Environments]. Journal of New Approaches in Educational Adminstration. 2023; 14(2): 33-49. [In Persian]

https://doi.org/10.52547/dsme.8.1.80

[16] Joughin G. Assessment, Learning and Judgement in Higher Education. Australia: Springer; 2009. P.21.

[17] Marriott P. Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. British Journal of Educational Technology. 2009; 40(2).

https://doi.org/10.1111/j.1467-8535.2008.00924.x

[18] Ortiz P. A. Teaching in the time of COVID-19. Biochemistry and Molecular Biology Education. 2020; 48(3), 201.https://doi.org/10.1002/bmb.21348

[19] Ilmi M. U, Setiawan F, Hikmah M. N, Kharisma A, Feryaman D, Hanafie A. A. The basic concepts of evaluation and its implementation in IRE lessons in the pandemic era. TAKFIR: Interdisciplinary Journal of Islamic Education. 2021; 2(2), 175-190. https://doi.org/10.31538/tijie.v2i2.50

[20] Bozkurt A, Jung I, Xiao J, Vladimirschi V, Schuwer R, Egorov G, … Paskevicius M. A global outlook to the interruption of education due to COVID-19 Pandemic. Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education. 2020; 15(1), 1-126.

[21] Fuller R, Joynes V, Cooper J, Boursicot K, Roberts T. Could COVID-19 be our ‘There is no alternative’ (TINA) opportunity to enhance assessment? Medical Teacher. 2020; 42(7), 781-786. https://doi.org/10.1080/0142159X.2020.1779206

[22] Al-Kadri H. M, Al-Moamary M, Al-Knawy B. Framework for curriculum delivery during COVID-19 pandemic in a health sciences university. Annals of Thoracic Medicine. 2020; 15(4),185-189. DOI: 10.4103/atm.ATM_493_20

[23] Zhao Y. COVOID-19 as a catalyst for educational change. Prospects. 2020; 49, 29-33.

https://doi.org/10.1007/s11125-020-09477-y

[24] Hatami J, Rezaei E, Maleki M. Assessment and evaluation in e-learning. 2021. [In Persian]

[25] Ali W. Online and remote learning in higher education institutes: A necessity in light of COVID-19 pandemic. Higher Education Studies. 2020; 10(3), 16. Doi:10.5539/hes.v10n3p16

[26] Abbasi Kasani H, Shams Mourkani G, Seraji F, RezaeeZadeh M. [Learners Assessment tools in e-learning]. Journal of Roshd-e-Fanavari. 2020; 16(61): 23-33. [In Persian]

[27] Barari N, Alami F, Rezaeizadah M, Khorasani A. [Evaluating the Goals of High Levels of Learning in E-Learning Environments (Standards & Endicators)]. Journal of Education and evaluation (educational sciences). 2019; 12(45): 111-132. [In Persian]

[28] Manenova M. Evaluation of e-learning courses using communicative and cooperative tools. Social and Behavioral Sciences. 2015; 176: 884 – 890.

https://doi.org/10.1016/j.sbspro.2015.01.554.

[29] Rezaei A. [Student learning evaluation during the Corona: Challenges and Strategies]. Journal of Quarterly of Educational Psychology Allameh Tabataba’i University 2020; 16(55): 179-214. [In Persian]

https://doi.org/10.22054/jep.2020.52660.3012.

[30] Arbabi F. [Investigating the Effectiveness of Applying Developmental Assessment Strategies in E-Learning during the Quaid]. Era JNACE. 2022; 4(3) 198-205. [In Persian]

[31] Chgni H. Mohammadi Sh. Electronic Portfolio in Assessment and Evaluation. 13th National Education Conference. 2020. [In Persian]

[32] Elzaini A, El Sadik A, Al Abdulmonem W. Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University. Journal of Taibah University Medical Sciences. 2020; 15(6): 456-462. https://doi.org/10.1016/j.jtumed.2020.09.005.

[33] Hassani K, Shafiyan M, Mirzaee. Sh. [A Comparative study of the effects of face-to-face training and e-learning on the initial levels of learning in mathematics and elementary sciences]. Journal of Technology of Education.2023; 17(1): 39-50. [In Persian]

https://doi.org/10.22061/tej.2022.8836.2740

[34] Majeed B.H, Hussain A.Kh. The Impact of Reflexive Learning Strategy on Mathematics Achievement by First Intermediate Class Students and Their Attitudes Towards E-Learning. Turkish Journal of Computer and Mathematics Education (TURCOMAT). 2021; 12(7): 3271-3277.

[35] Sharifi M, Fathabadi J, Shokri O, Pakdaman Sh. [The experience of e-learning in the educational system of Iran: Meta-analysis of the effectiveness of e-learning in comparison to face-to-face education]. Journal of Research in School and Virtual Learning. 2019; 7(1): 9-24. [In Persian]

https://doi.org/10.30473/etl.2019.6051

[36] Zaraii Zavaraki E, Rezaei E. [The Impact of Using E-portfolio on Attitude, Motivation and Academic Achievement of Students in Khajeh Nasirddin Toosi University's E- Learning Center]. Journal of Educational measurement. 2012; 2(5): 0-0. [In Persian]

[37] Samadi P, Ahmadi M. [Investigating the Strengths and Weaknesses of ICT Application in terms of the Curriculum (Centralization and Decentralization)]. Journal of New educational ideas. 2015; 11(2): 69-104. [In Persian]

DOI: 10.22051/jontoe.2015.1877

[38] Zarei Zavarki I, Safaei Mowahed S. [Translation of Electronic learning in the 21st century (theoretical and practical foundations)] Grayson, D.R, Anderson T (Author). Tehran: Science and Technology. First edition. First printing. 2004. [In Persian]

[39] Golzari Z, Kiamanesh A, Ghorchian N, Gafari P. [Development and accreditation of a model for internal evaluation of e-learning courses]. Journal of Higher Education Curriculum Studies. 2011; 1(1): 160-185. [In Persian]

[40] Babaie M. AN Introduction to E-Learning. Tehran: Iran Research Institute of Science and Information Technology: Chapar; 2010. [In Persian]

[41] Seyed Alian S.M, Salehi K. [The effect of using educational aids and information technology to improve mathematics learning in secondary school students]. Journal of Technology of Education. 2021; 15(4): 683-694. [In Persian]

https://doi.org/10.22061/tej.2021.6700.2450