تقصّي الثبات لمقياس إستراتيجيات التعلّم المنظّم ذاتياً في ضوء النسب المفقودة وطرق تعويضها

taghreed hijazi

doi:10.35516/edu.v51i1.6154

Authors

taghreed hijazi Department of Guidance and Educational Psychology, College of Education, Yarmouk University, Irbid, Jordan https://orcid.org/0009-0001-8581-2029

DOI:

https://doi.org/10.35516/edu.v51i1.6154

Keywords:

Missing Data, imputation methods, expectation maximization, multiple imputation

Abstract

Objectives: This study aims to investigate the stability coefficients (alpha for Cronbach and omega for McDonald) for the Self-Regulated Organizational Learning Strategies Scale using the methods of maximum likelihood and multiple imputation. This exploration was conducted in scenarios where there were no missing values and in cases where missing values were present at different proportions, with subsequent treatment using both maximum expectation and multiple imputation techniques.

Methods: To achieve the study's objectives, a scale of Self-Regulated Organizational Learning Strategies consisting of 77 items was administered to a randomly selected sample of 980 undergraduate students from various disciplines at Yarmouk University. Data were subjected to complete random missingness at rates of 5%, 15%, and 30%. The missing values were then inputted using both maximum expectation and multiple imputation techniques. Stability coefficients (alpha for Cronbach and omega for McDonald) were calculated for the scale in each research scenario.

Results: The study's results indicated that the values of alpha and omega coefficients obtained using the maximum expectation method were higher than those obtained with the multiple imputation method, across various rates of missingness (5%, 15%, 30%).

Conclusions: The study recommends paying more attention to missing data in the design and analysis of studies, understanding the reasons behind data loss, avoiding arbitrary selection of methods for handling missing data, using multiple imputation methods for data comparison, and considering the use of omega for McDonald's coefficient as an alternative to Cronbach's alpha.

Downloads

Download data is not yet available.

References

Akbas, U., & Tavsancil, E. (2015). Investigation of Psychometric Properties of Scales with Missing Data Techniques for Different Sample Sizes and Missing Data Patterns. Journal of Measurement and Evaluation in Education and Psychology-EPOD, 6(1), 38-57.

Allison, P. D. (2002). Missing data. Sage publication. Doi: https://doi.org/10.4135/9781412985079

Baraldi, A.N., & Enders, C. K. (2009). An Introduction to modern missing data analysis. Journal of School Psychology, 48(1), 5-37. doi: 10.1016/j.jsp.2009.10.001.

Bhandari, P. (2022). Missing Data | Types, Explanation, & Imputation. Scribbr. https://www.scribbr.com/statistics/missing-data/

Béland, S., Pichette, F., & Jolani, S. (2016) Impact on Cronbach’s α of simple treatment methods for missing data. The Quantitative Methods for Psychology, 12(1), 57-73.

Bonniga, R., & Saraswathi, A. B. (2020). Literature Review of Cronbach alphacoefficient and Mcdonald's Omega Coefficient. European Journal of Molecular & Clinical Medicine, 7(6), 2943-2949. Doi:10.13140/RG.2.2.35489.53603

Carpita, M., & Manisera, M. (2011). On the imputation of missing data in surveys with Likert-type scales. Journal of Classification, 28(1), 93-112. DOI:10.1007/s00357-011-9074-z

Cokluk, O., & Kayri, M. (2011). The Effects of methods of imputation for missing values on the validity and reliability of scales. Educational Sciences: Theory & Practice 11(1), 303-309.

Dai, S. (2021). Handling missing responses in psychometrics: Methods and software. Educational Psychology, 3(4), 673-693; https://doi.org/10.3390/psych3040043

Dunn, T. J., & Baguley, T. (2013). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 1-12. Doi: 10.111/bjop.12046

Enders, C. K. (2004). The Impact of Missing Data on Sample Reliability Estimates: Implications for Reliability Reporting Practices. Educational and Psychological Measurement, 64(3), 419–436. doi.org/10.1177/0013164403261050

Enders, C. K. (2006). A primer on the use of modern missing-data methods in psychometric medicine research. Psychosomatic Medicine, 68 (3), 427-436. Doi: 10.1097/01.psy.0000221275.75056.d8.

Enders, C. K. (2010). Applied missing data analysis. Guilford Press.

Fauzi, A., & Widjajanti, D. B. (2018). Self-regulated learning: the effect on student’s mathematics achievement. Journal of Physics Conference Series, 1097(1), 012139. Doi: 10.1088/1742-6596/1097/1/012139

Graham, J. W. (2009). Missing Data Analysis: Making It Work in the Real World. Annual Review of Psychology, 60, 549-576. http://dx.doi.org/10.1146/annurev.psych.58.110405.085530

Hayes, A. F., & Coutts, J. J. (2020) Use Omega Rather than Cronbach’s Alpha for Estimating Reliability. But…, Communication Methods and Measures, 14(1), 1-24. DOI: 10.1080/19312458.2020.1718629

Jackson, C. R. (2018). Validating and Adapting the Motivated Strategies for Learning Questionnaire (MSLQ) for STEM Courses at an HBCU. AERA Open 4(4), 1–16. Doi: 10.1177/2332858418809346

Jdaitawi, M. M. (2016). Factorial Validity and Reliability of Self-Regulation Learning Questionnaire among Undergraduate Students at University of Dammam in Saudi Arabia. Journal of Educational and Psychological Studies, Sultan Qaboos University, 10 (4), 669-679.

Kang, H. (2013). The Prevention and handling of missing data. Korean Journal of Anesthesiol, 64(5), 402-406.

Kwak S.K., & Kim, J.H. (2017). Statistical data preparation: management of missing values and outliers. Korean Journal Anesthesiology, 70(4), 407-411. Doi: 10.4097/kjae.2017.70.4.407.

Linn, R. L. (1989). Educational Measurement. (3rd ed.). Macmillan Publishing Company.

Magno, C. (2011). Validating the Academic Self-Regulated Learning Scale with the Motivated Strategies for Learning Questionnaire (MSLQ) and Learning and Study Strategies Inventory (LASSI). The International Journal of Educational and Psychological Assessment, 7(2), 56-73.

Matysova, K. (2019). Evaluation of Modern Missing Data Handling Methods for Coefficient Alpha. Public Access Theses and Dissertations from the College of Education and Human Sciences, 347. https://digitalcommons.unl.edu/cehsdiss/347

McKnight, P. E., McKnight, K. M., Sidani, S., & Figueredo, A. J. (2007). Missing data: A gentle introduction. Guilford Press.

Panadero, E. (2017). A Review of Self-regulated Learning: Six Modeles and Four Directions for Research. Front Psychology, 8, 422-422. doi.org/10.3389/fpsyg.2017.00422

Reimann, P., & Bannert, M. (2018). Self-regulation of learning and performance in computer-supported collaborative learning environments. In D. H. Schunk & J. A. Greene (Eds.), Handbook of self-regulation of learning and performance (pp. 285–303). Routledge/Taylor & Francis Group. doi.org/10.4324/9781315697048-19

Rippe, R., Den heijer, M. & Le Cessie, S. (2013). Imputation of missing data. Nederlands Tijdschrift Voor Geneeskunde, 157(18), 39-55.

Schfer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7 (2), 147-177. doi.org/10.1037/1082-989X.7.2.147

=Schafer, J. L., & Oslen, M. K. (1998). Multiple imputation for multivariate missing-data problems: A data analyst’s perspective. Multivariate Behavioral Research, 33 (4), 545-571. doi.org/10.1207/s15327906mbr3304_5

Tamboli, N. (2021). Effective strategies for handling missing values in data analysis.

https://www.analyticsvidhya.com/blog/2021/10/handling-missing-value/

Wolters, C. A., Pintrich, P. R., & Karabenick, S. A. (2003). Assessing Academic Self-regulated Learning. Paper presented at the Conference.

Xueying, X., Leizhen X., Qimeng Z., Shaoning, W., Mingcheng, W., & Hongbo, L. (2020). The ability of different imputation methods for missing values in mental measurement questionnaires. BMC medical research methodology, 20(1), 1-9. Doi: 10.1186/s12874-020-00932-0.

Zekeriya, N. (2015). Comparison of Various Methods Used in Solving Missing Data Problems in terms of Psychometric Features of Scales and Measurement Results under Different Missing Data Conditions. International Online Journal of Educational Sciences, 7 (4), 252 - 265

Zimmerman, B. J. (2023). Dimensions of academic self-regulation: A conceptual framework for education. In Self-regulation of learning and performance (pp. 3-21). Routledge.

Zimmerman, B. J., & Martinez-Pons, M. (1988). Construct validation of a strategy model of student self-regulated learning. Journal of Educational Psychology, 80 (3), 284–290. doi.org/10.1037/0022-0663.80.3.284