ERIC Number: EJ954590
Record Type: Journal
Publication Date: 2011
Abstractor: As Provided
Reference Count: N/A
Understanding Rasch Measurement: A Mapmark Method of Standard Setting as Implemented for the National Assessment Governing Board
Schulz, E. Matthew; Mitzel, Howard C.
Journal of Applied Measurement, v12 n2 p165-193 Sum 2011
This article describes a Mapmark standard setting procedure, developed under contract with the National Assessment Governing Board (NAGB). The procedure enhances the bookmark method with spatially representative item maps, holistic feedback, and an emphasis on independent judgment. A rationale for these enhancements, and the bookmark method, is presented, followed by a detailed description of the materials and procedures used in a meeting to set standards for the 2005 National Assessment of Educational Progress (NAEP) in Grade 12 mathematics. The use of difficulty-ordered content domains to provide holistic feedback is a particularly novel feature of the method. Process evaluation results comparing Mapmark to Anghoff-based methods previously used for NAEP standard setting are also presented.
Descriptors: Standard Setting, Methods, National Competency Tests, Grade 12, Mathematics Tests, Standards, Feedback (Response), Formative Evaluation
JAM Press. P.O. Box 1283, Maple Grove, MN 55311. e-mail: firstname.lastname@example.org; Web site: http://www.jampress.org
Publication Type: Journal Articles; Reports - Descriptive
Education Level: Grade 12; High Schools; Secondary Education
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress