Judgmental standard setting methods have been criticized for the cognitive complexity of the judgment task that panelists are asked to complete. This study compared two methods designed to reduce this complexity: the yes/no method and the single-passage bookmark method. Two mock standard setting panel meetings were convened, one for each method, using experienced third-grade teachers as panelists. The methods produced very similar cut scores and they seemed to succeed in reducing the cognitive complexity of the judgment task. There was also evidence, however, that the participants in both groups experienced a great deal of difficulty in estimating item performance for borderline students and that they may have used contextual information associated with the judgmental task to estimate their cut scores. (Contains 8 tables and 2 figures.)