ERIC Number: EJ1218307
Record Type: Journal
Publication Date: 2019
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2375-5636
EISSN: N/A
Bridging the Standard Setting Gap via Assessment Engineering
Furter, Robert T.
Journal of Applied Testing Technology, v20 spec iss 2 p60-70 2019
Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g. content of the item, examinee data, performance data) with performance level descriptors, borderline candidate conceptualizations, etc. The ability of subject matter experts to recommend a cut score that accurately differentiates between levels of proficiency is directly impacted by the level of alignment between the conceptualization of the construct and the more concrete test or examinee content upon which they are making judgments. Assessment engineering is a principled assessment framework that, in addition to infusing manufacturing and quality control principles into the test development cycle, builds in a high level of connectivity between the claims we wish to make about examinees and the items they are administered. This paper focuses on the role assessment engineering infrastructure can play in helping standard setting-panelists bridge the gap between the claims testing bodies wish to make about examinees and the item-level information they are typically provided, and, in doing so, strengthen the validity argument for an instrument's score interpretations.
Descriptors: Standard Setting, Cutting Scores, Decision Making, Test Construction, Pedagogical Content Knowledge, Specialists, Test Items, Accuracy, Alignment (Education), Guidelines, Role, Scores, Systems Approach, Validity
Association of Test Publishers. 601 Pennsylvania Avenue NW, South Building Suite 900, Washington DC 20004. Tel: 866-240-7909; Fax: 717-755-8962; e-mail: wgh.atp@att.net; Web site: http://www.testpublishers.org
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A