فحص جودة البنود وشواهد الثبات لمقياس القدرات العقلية المتعددة باستخدام نظرية استجابة البند

Document Type : Original Article

Author

Associate Professor of Measurement and Evaluation, Taiba University, and Full-Time Consultant, National Measurement Authority

Abstract

      The goal of this study is to examine the quality of items and provide evidences of the reliability of the Multiple Cognitive Abilities Assessment of the third grade (MAWHIBAH scale) by using Item Response Theory (IRT).
A random sample of (15,762) was selected from the population of  all third-grade students from general education schools in all regions of the Kingdom of Saudi Arabia, who were elected by school teachers, parents or students self-election to participate in the National Project for  Identifying Gifted Students.
     The statistics indices estimated from  the IRT models and all its psychometric components were used to examine the quality of the items and identify evidences of the reliability (e.g., distribution of ability scores, the Item-Person map, the test information function, conditional error of measurement, item analysis of the IRT parameters, item fit analysis,  evaluation of the reliability coefficients according to the concepts of the IRT models, calculation of the classical reliability coefficient by using the item parameters of the IRT models.
  The results of this study found that the MAWHIBAH scale has  high quality items and  high reliability when the inappropriate items were deleted from the analysis. The study showed a practical example for test developers to analyze their tests and instruments to examine their item quality and reliability.
Key Words: Giftedness, Gifted Test, Item Response Theory, Reliability,   Multiple   Cognitive Abilities Assessment (MAWHIBAH scale).

References

1-   Assessment System Corporation (2012). User’s manual for Xcalibre: Item response theory calibration software (version 4.1.8).St. Paul. Minnesota: Author.
2-   Carroll, J. B. (1993). Human Cognitive Abilities: A Survey of Factor-Analytic Studies. New York: Cambridge University Press.
3-   Cattell, R. B. (1963). Theory of fluid and crystallized intelligence: A critical experiment. Journal of Educational Psychology, 54(1), 1-22.
4-   Dimitrov, D.M. (2003a). Marginal true-score measures and reliability of binary items as a function of their IRT parameters. Applied Psychological Measurement, 27(6), 440-458.
5-   Dimitrov, D. M. (2003b). IRT-TRUE: A computer program for true-score measures of binary items as a function of their IRT calibration. Fairfax, VA: George Mason University, Graduate School of Education.
6-   Feldhusen, J. F. (1998). Programs for the gifted few or talent development for the many? Phi Delta Kappan, 79(10), 735-738.
7-   Gagné, F. (2005). From gifts to talents: the DMGT as a developmental model. In R. J. Sternberg, Davidson, J. E. (Ed.), Conceptions of giftedness, second edition (pp. 98-119). New York: Cambridge University Press.
8-   Gardner, H. (1983). Frames of mind: The theory of multiple intelligences. New York: Basic Books.
 
 
 
 
9-   Grigorenko, E. L. (2008). Hitting, missing, and in between: a typology of the impact of western education on the non-western world. In J. G. Elliott & E. L. Grigorenko (Eds.), Western psychological and educational theory in diverse contexts (pp. 165-186). London, UK: Routledge.
10-  Guilford, J. P. (1967). The Nature of Human Intelligence. New York: McGraw-Hill.
11-  Guilford, J. P. (1982). Cognitive psychology's ambiguities: Some suggested remedies. Psychological Review, 89, 48-59.
12-  Guilford, J. P. (1988). Some Changes in the Structure-of-Intellect Model. Educational and
13-  Heller, K. A., Perleth, C., & Lim, T. K. (2005). The Munich model of giftedness designed to identify and promote gifted students. In R. J. Sternberg & J. E. Davidson (Eds.), Conceptions of giftedness (2 ed., pp. 147-170). New York: Cambridge University Press.
14-  Hambleton, R., Swaminathan, & Rogers, H. (1991).  Fundamentals of Item response theory.  Newbury Park: SAGE Publications.
15- Horn, J. L. (1968). Organization of Abilities and the Development of Intelligence
16-  Marland, S. P. J. (1972). Education of the gifted and talented (Vol. 1). Washington, DC: U.S. Government Printing Office.
17-  Mönks, F. J. (1992). Development of gifted children: The issue of identification and programming. In F. J. Mönks & W. A. M. Peters (Eds.), Talent for the future: Social and personality development of gifted children: Proceedings of the Ninth World Conference on Gifted and Talented Children (2 ed., pp. 191-202). Assen, The Netherlands: Van Gorcum & Co.
 
 
18-  Mönks, F. J., & Katzko, M. W. (2005). Giftedness and gifted education. In R. J. Sternberg & J. E. Davidson (Eds.), Conceptions of giftedness (2 ed., pp. 187-200). New York, NY: Cambridge University Press.
19- Renzulli, J. S. (1978). What makes giftedness? Re-examining a definition. Phi Delta Kappan, 60, 180-184.
20-  Renzulli, J. S. (2005). The three-ring conception of giftedness. In R. J. Sternberg & J. E. Davidson (Eds.), Conceptions of giftedness (2 ed., pp. 246-279). New York, NY: Cambridge.
21-  Simonton, D. K. (2000). Genius and giftedness: same or different? In K. A. Heller, Monks, F. J., Sternberg, R. J., Subotnik, R.F. (Ed.), International Handbook of Giftedness and Talent (pp. 111-121). Oxford: Elsevier Science Ltd.
22-  Spearman, C. (1927). The Abilities of Man. London: Macmillian.
23-  Sternberg, R. J. (1988). The triarchic mind: A new theory of human intelligence. New York: Viking.
24-  Sternberg, R. J. (1999). A triarchic approach to the understanding and assessment of intelligence in multicultural populations. Journal of School Psychology, 37 145-159.
25-  Sternberg, R. J. (2003). Wisdom, intelligence, and creativity synthesized. New York, NY: Cambridge.
26-  Sternberg, R. J. (2005b). The WICS model of giftedness. In R. J. Sternberg, Davidson, J. E. (Ed.), Conceptions of giftedness, second edition (pp. 327-342). New York: Columbia University Press.
27-  Tannenbaum, A. J. (1983). Gifted children: Psychological and educational perspectives. New York, NY: Macmillan.
28-  Tannenbaum, A. J. (1986). Giftedness: a psychosocial approach. In R. J. D. Sternberg, J.E. (Ed.), Conceptions of giftedness (pp. 21-52). New York: Cambridge University Press.
29-  Terman, L. M. (1925). Mental and physical traits of a thousand gifted children. Stanford, CA:
30-  Vernon, P. E. (1971). The structure of human abilities. London: Methuen.
31-  Ziegler, A., & Stoeger, H. (2007). The Germanic view of giftedness. In S. N. Phillipson & M. McCann (Eds.), What does it mean to be gifted? Socio-cultural perspectices (pp. 65-98).
 

Files

Share

How to cite

Statistics