NotesFAQContact Us
Search Tips
ERIC Number: ED523026
Record Type: Non-Journal
Publication Date: 2010
Pages: 147
Abstractor: As Provided
Reference Count: 0
ISBN: ISBN-978-1-1244-0544-5
Generalizability Theory: Measuring the Dependability of Selected Methods for Scoring Classroom Assessments
Lengh, Carolyn J.
ProQuest LLC, Ph.D. Dissertation, Cardinal Stritch University
This study compares the dependability of four classroom assessment scoring methods. Generalizability theory (G) and alternative decision (D) are used to measure the results of students' classroom assessment scores and compare the results of the four scoring methods on variability of rater by person variance and the level of G and D coefficients within each study. This research study builds on a similar study by Marzano (2002) and contributes to a body of knowledge by filling in the gaps about how classroom teachers score assessments. This generalizability study reports the findings from a two-part study. In the first part of the study, an unconstrained point method of scoring short-answer social studies assessments is compared to a generic rubric method of scoring. In the second part of the study, a constrained point method of scoring short-answer social studies tests is compared to a topic-specific rubrics method of scoring. This study suggests that, generalizability theory (G) is used to estimate the amount of variance in scores from one rater to another within each scoring method, while comparing the variability across methods and the two parts of the study. In this study, generalizability analysis results help the educational community understand the relative importance of various sources of measurement error and also assist in choosing and redesigning efficient measurement procedures for scoring classroom assessment meant to minimize error and maximize reliability. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page:]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site:
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A