ERIC Number: ED390926
Record Type: Non-Journal
Publication Date: 1995-Aug
Reference Count: N/A
Using Judgmental Estimates of Item Difficulty To Assemble Test Forms with Equivalent Cut Scores. Research Memorandum.
Smith, Robert L.; Carlson, Alfred B.
The feasibility of constructing test forms with practically equivalent cut scores using judges' estimates of item difficulty as target "statistical" specifications was investigated. Test forms with equivalent judgmental cut scores (based on judgments of item difficulty) were assembled using items from six operational forms of the Multi-State Insurance Licensure Program examination. Nineteen judges took part in the standard setting session. Comparisons between the judgmental and equated cut scores showed the judgmental cut scores to differ by one or two raw score points from cut scores obtained through equating procedures. Comparisons of equated cut scores for test forms constructed using judgmental estimates of item difficulty and those constructed using classical statistics suggested that judgmental estimates of item difficulty may be suitable for use as target "statistical" specifications when empirical item difficulties are not available or are unstable due to small sample size. (Contains 2 tables, 6 figures, and 2 references.) (SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.