ERIC Number: ED400331
Record Type: Non-Journal
Publication Date: 1996-Feb
Reference Count: N/A
Reliability of Advanced Placement Examinations.
Bridgeman, Brent; And Others
The various methods for computing the reliability of scores on Advanced Placement (AP) examinations are summarized. For the free response portion of the examinations, raters can contribute to score unreliability through both systematic severity errors (in which some raters consistently rate more severely than other raters) and through inconsistency. Inconsistency appears to be a much greater problem than systematic severity errors. Question-to-question variation (or score reliability) is seen as a greater problem than rater inconsistencies. The impact of increasing or decreasing the number of topics is demonstrated by showing the proportion of students correctly classified as the number of topics changes using the results of AP examinations for the 1993 school year. Procedures to enhance both rate and score reliability are discussed. A table of score reliability and correct grade classifications is presented as an appendix. (Contains 1 table, 3 figures, 1 appendix table, and 15 references.) (Author/SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Identifiers - Assessments and Surveys: Advanced Placement Examinations (CEEB)