The effect of sample size on the accuracy of estimates of: the difficulty parameter of the test items, and the ability parameter for individuals in the analysis sample using the three-parameter logistic model

Al-Shafi’i, Muhammad Mansour Muhammad

doi:10.21608/jealex.2024.371247

The effect of sample size on the accuracy of estimates of: the difficulty parameter of the test items, and the ability parameter for individuals in the analysis sample using the three-parameter logistic model

Document Type : Original Article

Author

Muhammad Mansour Muhammad Al-Shafi’i

أستاذ القياس والإحصاء- قسم علم النفس - كلية الدراسات الإنسانية والإدارية- كليات عنيزة بالقصيم

10.21608/jealex.2024.371247

Abstract

The study aimed to reveal the effect of sample size on estimates of vocabulary difficulties and individuals’ abilities using analyzes of the three-teacher logistic model. The size of the study sample was (1800) individuals, where the researcher applied an algebra test for the second year of secondary school (consisting of 40 test items from the selection type). Multiple), on four samples of different sizes (900, 600, 300, 1800) individuals. In the analyzes of the study, the researcher used the statistical analysis programs SPSS v.27 and -Bilog_MG3 to conduct analyzes of the test items. The results used measurement errors as an indicator of accuracy. Measurement and detection of significant differences between corresponding difficulty estimates. The study also used the multiple measurement analysis of variance method to detect significant differences between corresponding ability estimates resulting from analyzing the responses of different sizes of the sample. The results of the study resulted in the presence of statistically significant differences when estimating the difficulties of the test items due to differences in size. The sample also shows that the accuracy of estimating the difficulties of the test items, as well as the accuracy of estimating individuals’ abilities, increases with increasing sample size

Keywords

References

-Belov, D. I. & Armstrong, R. D. (2010). Automatic detection of answer copying via kullback-leibler divergence and K- index. Applied psychological Measuement, 34(6), 379-392.

-De Ayala,R.J.(2022).The Theory and Practice of Item Response Theory,2Ed.NY.the Guilford press.

- De la Torre, J.; Yuan H. (2020). Parameter Estimation with Small Sample Size A Higher-Order IRT Model Approach. Applied Psychological Measurement. 28 (4), 255-272.

- Emberson, S. & Reise, S (2015). Item Response Theory for Psychologists ,New Jersey: Lawrence Earlbaum Associates, Publishers Mahwa.

- Hambleton, R., Swaminathan, H. &Rogers, H. (1991). Fundamentals of item response theory, International Educational and Professional. Publisher Newbury Park.

- Gessaroli ME & De Champlain A. (2005). Test dimensionality: Assessment of. In: Everitt BS, Howell DC, Eds.Encyclopedia of Statistics in Behavioral Science. Chichester:John Wiley & Sons.