ERIC Number: ED320943
Record Type: RIE
Publication Date: 1989-Mar
Reference Count: N/A
Critical Items and Standard Setting for Health Certification Examinations.
Friedman, Charles B.
In most judgmental methods for setting performance standards, content experts evaluate test items based on a conceptualization of a borderline examinee or a group of examinees. An alternative method is proposed by which judges evaluate items based on the degree of criticality regardless of content area. This classification of items serves to link the job analysis stage of test development to the standard setting process of examination administration. Based on the ratings of seven judges of a national health certification examination administered in March of 1988 to 635 entry-level examinees, a special critical item section score was calculated. This subscore was evaluated for its internal consistency. Examinee performance on critical items was compared to the total test score and evaluated for its potential impact on the number of candidates passing or failing the test and as a criterion in setting a standard score. Implications for test validity are discussed. Three data tables are included. (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (San Francisco, CA, March 28-30, 1989).