ERIC Number: ED550413
Record Type: Non-Journal
Publication Date: 2012
Abstractor: As Provided
Reference Count: N/A
Oral Performace Scoring Using Generalizability Theory and Many-Facet Rasch Measurement: A Comparison Study
Alkahtani, Saif F.
ProQuest LLC, Ph.D. Dissertation, The Pennsylvania State University.
The principal aim of the present study was to better guide the Quranic recitation appraisal practice by presenting an application of Generalizability theory and Many-facet Rasch Measurement Model for assessing the dependability and fit of two suggested rubrics. Recitations of 93 students were rated holistically and analytically by 3 independent raters for their implementation of Quranic rules and proficiency of reading. Although, the relationship of raw scores of holistic and analytic revealed high estimates, suggesting that, on average, rank ordering of students was consistent across the scoring rubrics, a paired-sample t-test revealed statistically significant differences between their means. Furthermore, individual and overall comparisons of holistic and analytic scoring rubrics of Quranic recitations using MFRM showed that analytic scoring rubric is associated with better individual and overall fit statistics for all measurement facets. Likewise, G-theory analysis showed that analytic scoring rubrics were associated with lesser measurement errors and with higher coefficients of dependability (i.e., G-coefficients, and D-indices). The introduction of analytic rubrics might have helped guide raters to evaluate students' recitations more consistently and bring raters to a common understanding of the scoring scales. Such findings might lend more support to the introduction of analytic scoring to the Quranic assessment practice, as it guides raters to rate consistently and similarly. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
Descriptors: Generalizability Theory, Item Response Theory, Verbal Tests, Islam, Scoring Rubrics, Reading Achievement, Comparative Analysis, Statistical Analysis, Error of Measurement, Scoring, Interrater Reliability
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Authoring Institution: N/A