PDF pending restoration
ERIC Number: ED298171
Record Type: Non-Journal
Publication Date: 1985
Reference Count: N/A
Prediction of Item Performance by Expert Judges: A Methodology for Examining the Impact of Correction-for-Guessing Instructions on Test Taking Behavior.
Plake, Barbara S.; Melican, Gerald J.
A methodology for investigating the influence of correction-for-guessing directions and formula scoring on test performance was studied. Experts in the test content field used a judgmental item appraisal system to estimate the knowledge of the minimally competent candidate (MCC) and to predict those items that the MCC would omit on the test under correction-for-guessing and formula scoring directions. The ability of these experts to anticipate test behavior correctly was examined using a 28-item five option multiple choice mathematics achievement test requiring a clear statement when an item was omitted. A total of 156 students at a large midwestern university in the fall of 1985 took the examination. Ten professors using the Nedelsky method served as judges. The judges did a reasonable, although imperfect, job of picking items to be omitted. Results suggest that expert judgment may be used to assist researchers in formula scoring studies. (SLD)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: N/A