ERIC Number: EJ1023505
Record Type: Journal
Publication Date: 2013
Abstractor: As Provided
Reference Count: 53
Construct Maps as a Foundation for Standard Setting
Wyse, Adam E.
Measurement: Interdisciplinary Research and Perspectives, v11 n4 p139-170 2013
Construct maps are tools that display how the underlying achievement construct upon which one is trying to set cut-scores is related to other information used in the process of standard setting. This article reviews what construct maps are, uses construct maps to provide a conceptual framework to view commonly used standard-setting procedures (the Angoff, Bookmark, Mapmark, Briefing Book, Body of Work, Contrasting Groups, Borderline Groups, and Construct Mapping methods), and describes how construct maps can be applied to set cut-scores and provide feedback, evaluate standard-setting methods, and synthesize data from various standard-setting methods when deciding on cut-scores. Suggestions of how construct maps could help resolve several of the common criticisms of operational standard-setting procedures, including issues related to panelist inconsistency and score gaps, are also provided. An example from a large-scale state-testing program illustrates how construct maps may be applied in practice.
Descriptors: Standard Setting (Scoring), Maps, Cutting Scores, Methods, Feedback (Response), Evaluation, Data, Synthesis, Mathematics Tests, Alternative Assessment, Grade 5, Item Response Theory, Performance, Standards, Interrater Reliability
Psychology Press. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 5; Elementary Education; Intermediate Grades
Authoring Institution: N/A