NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ923311
Record Type: Journal
Publication Date: 2011-Jun
Pages: 22
Abstractor: As Provided
ISSN: ISSN-0013-1644
Reducing the Cognitive Complexity Associated with Standard Setting: A Comparison of the Single-Passage Bookmark and Yes/No Methods
Skaggs, Gary; Hein, Serge F.
Educational and Psychological Measurement, v71 n3 p571-592 Jun 2011
Judgmental standard setting methods have been criticized for the cognitive complexity of the judgment task that panelists are asked to complete. This study compared two methods designed to reduce this complexity: the yes/no method and the single-passage bookmark method. Two mock standard setting panel meetings were convened, one for each method, using experienced third-grade teachers as panelists. The methods produced very similar cut scores and they seemed to succeed in reducing the cognitive complexity of the judgment task. There was also evidence, however, that the participants in both groups experienced a great deal of difficulty in estimating item performance for borderline students and that they may have used contextual information associated with the judgmental task to estimate their cut scores. (Contains 8 tables and 2 figures.)
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Grade 3; Primary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A