The Effectiveness of Hypertext Annotations on Learners' Vocabulary Learning: A Meta-analysis

Vahedi, V. S.

doi:10.22061/tej.2020.6723.2441

Document Type : Original Research Paper

Author

V. S. Vahedi

Department of English Language, Qaenat Branch, Islamic Azad University, Qaenat, Iran

https://doi.org/10.22061/tej.2020.6723.2441

Abstract

CALL) programs have been incorporated into language classrooms over the past five decades, it has become more important to find a clear answer to questions such as to what extent, and under which moderator variables CALL programs can yield more effective outcomes as compared to traditional language instruction. The present meta-analysis is a comprehensive investigation to determine the extent of the effectiveness of hypertext annotations on the learners' vocabulary learning. Moreover, the study aimed at identifying the moderator variables that influence the heterogeneity of the effect of various studies.
Methods: The statistical population of the present study consisted of all the studies conducted in the past related to the effectiveness of hypertext annotations on learners' vocabulary learning. To this aim, an exhaustive research of the multiple electronic databases was carried out in order to identify all the studies examining the relative effectiveness of CALL on enhancing learners' vocabulary learning The main criterion for selecting the studies to be analyzed in the present research was their publication in journals or proceedings of conferences during the period between 1950 to 2014. Concurrently, the experts in this area were also consulted for articles that had not been identified in the primary search. Eventually, the search process resulted in the identification of 132 articles of potential relevance to the present meta-analysis. In the next stage, all studies were investigated more carefully and examined based on the checklist which was the criterion for the final selection of those studies that should be included in the present meta-analysis. Finally, a total sample of 36 studies met the required criteria and selected for the final analysis. Data analysis was performed using Comprehensive Meta-analysis Software (Version 2).
Findings: With respect to the overall effect size of the hypertext annotations on the students’ vocabulary acquisition, the results of 36 study in the present meta-analysis revealed that hypertext annotations had a large, positive, significant effect on students' vocabulary. Acquisition (+140). In addition, there was a highly significant heterogeneity in the distribution of the effect sizes in the meta-analysis under investigation. To further explore the sources of the heterogeneity between the effect sizes across studies, moderator analyses were administered in terms of six variables (research design, sample size, proficiency level, age, duration of the program, year of publication). It was found that the variable of the sample size had significantly affected the inconsistency of the effect sizes across the studies under investigation to the extent that studies with a sample size of more than 60 individuals produced a large effect size, whereas studies with sample size of less than 60 individuals generated medium effect size. Another significant finding was that the mean of the effect sizes statistically differed across different duration levels of the teaching program. That is, studies with a higher duration of teaching program had a larger mean effect size than those with a lower duration, indicating that the learners' vocabulary achievement enhances significantly as the length of the teaching program increases. Moreover, the results revealed that publication year was also a significant moderator variable so that the studies published in the recent years had a higher effect size as compared with those published in earlier years. Other findings revealed that the dissimilarity of the effect sizes in the present meta-analysis was not influenced by the differences among research design, proficiency level, and age of the language learners.
Conclusion: Based on the findings of the present meta-analysis, it is necessary to integrate CALL into traditional language classes in order to reach better learning outcomes. With respect to future research, the researchers are recommended to provide more details of the study so that it could be possible to confirm or reject the factors that are effective in the role of computer in second language (L2) learning.

Keywords

20.1001.1.20080441.1400.15.2.10.7

Main Subjects

Educational Technology

COPYRIGHTS
©2021 The author(s). This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.

References

[1] Cheung A, Slavin R. The effectiveness of education technology for enhancing reading achievement: A meta-analysis. Us: Best Evidence Encyclopedia. 2011.

[2] Schwarz G. Renewing teaching through media literacy. Phi Delta Kappan. 2000; 37: 8-12.

[3] Basena D, Jamieson J. CALL research in second language learning 1990-1994. CAELL Journal. 1996; 7 1(2): 14-22.

[4] Ariew R, Ercetin G. Exploring the potential of hypermedia annotations for second language reading. Computer Assisted Language Learning. 2004; 17(2): 237–259.

[5] Glass G. Integrating findings: The meta-analysis of research. Review of Research in Education. 1977; 5: 351-379.

[6] Hedges L, Olkin I. Statistical methods for meta-analysis. Orlando: Academic Press; 1985.

[7] Knight S. Dictionary use while reading: The effects on comprehension and vocabulary acquisition for students of different verbal abilities. Modern Language Journal. 1994; 78: 285-299.

[8] Hulstijn HJ, Hollander M, Greidanus T. Incidental vocabulary learning by advanced foreign language students: The influence of marginal glosses, dictionary use, and reoccurrence of unknown words. Modern Language Journal. 1996; 80: 327-339.

[9] Watanabe Y. Input, intake, retention: Effects of increased processing on incidental learning of foreign language vocabulary. Studies in Second Language Acquisition. 1997; 19: 287-307.

[10] Boers F, Stengers H. Researching mnemonic techniques through CALL: The case of multiword expressions. Proceedings of the eleventh international CALL conference, 2004; 43-8. Antwerp: University of Antwerp.

[11] Abraham LB. Computer-mediated glosses in second language reading comprehension and vocabulary learning: A meta-analysis. Computer Assisted Language Learning. 2008; 21(3): 199–226.

[12] Zandieh, Z, Jafarigohar M. The effects of hypertext gloss on comprehension and vocabulary retention under incidental and intentional learning conditions. English Language Teaching. 2012; 5(6), 60-71.

[13] Ghahari S, Heidarolad M. Glossing, inferencing, and incidental vocabulary learning. English Language Teaching and Literature. 2010; 3(1): 20-34.

[14] Ghaderi V, Afshinfar J. A comparative study of the effects of animated versus static funny pictures on Iranian intermediate EFL students' intake retention of idioms. Procedia - Social and Behavioral Sciences. 2014; 98, 522 – 531.

[15] Zarei A A , Mahmoodzadeh P. The effect of multimedia glossing on L2 reading comprehension and vocabulary production. Journal of English Language Literature. 2014; 1(1): 1-7.

[16] Zhang B. Presentation modes and vocabulary learning and retention effects. Language Learning & Technology. 2008; 4(1): 23-34.

[17] Pishghadam R, Ghahari Sh. The impact of glossing convention on incidental vocabulary learning: a comparative study. Iranian EFL Journal. 2011; 7(6): 8-29.

[18] Rasaei E. Computer-mediated textual and audio glosses, perceptual style and L2 vocabulary learning. Language Teaching Research. 2018; 22(6):129-139.

[19] Ashraf H, Ghanei Motlagh F, Salami M. The impact of online games on learning English vocabulary by Iranian (low-intermediate) EFL learners. Proceedings of the International Conference on Current Trends in ELT, 2014; pp 286 – 291.

[20] Warren P, Boers F, Grimshaw G, Siyanova A. The effect of gloss type on learners' intake of new words during reading: evidence of eye-tracking. Studies in Second Language Acquisition. 2018; 40(4): 883-906.

[21] Ebadi S, Bashiri S. Investigating EFL Learners' Perspectives on Vocabulary Learning Experiences through Smartphone Applications. Teaching English with Technology. 2018; 18 (3): 126-151.

[22] Zhao Y. Recent development in technology and language learning: A literature review and meta-analysis. CALICO Journal. 2003; 21(1): 7–27.

[23] Taylor AM. The effects of CALL versus traditional L1 glosses on L2 reading comprehension. CALICO Journal. 2006; 23(2): 309–318.

[24] Glass G V. Primary, secondary, and meta-analysis of research. Educational Researcher. 1976; 5: 3–8.

[25] Cochran WG. The combination of estimates from different experiments Biometrics. Oxford: Oxford Publication; 1954.

[26] Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine. 2002; 21: 1539–1558.

[27] Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analysis. BMJ. 2003; 327: 557–560.

[28] Norris J, Ortega L. Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning. 2000; 50: 417–528.

[29] Liao YKC. Effects of hypermedia on students' achievement: A meta-analysis. Journal of Educational Multimedia and Hypermedia. 1999; 8(3): 255-277.