NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1153730
Record Type: Journal
Publication Date: 2017
Pages: 10
Abstractor: As Provided
ISSN: ISSN-0895-7347
Evaluating Score and Decision Consistency across Claims in a Validation Argument
Schmidgall, Jonathan
Applied Measurement in Education, v30 n4 p287-296 2017
This study utilizes an argument-based approach to validation to examine the implications of reliability in order to further differentiate the concepts of score and decision consistency. In a methodological example, the framework of generalizability theory was used to estimate appropriate indices of score consistency and evaluations of the likelihood of decision errors based on the design of a performance assessment and its intended use. The study illustrates how generalizability theory can be applied to address various claims about consistency when decisions are based on two or more cut scores, and results underscore the importance of considering score and decision consistency separately.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: California (Los Angeles)
Grant or Contract Numbers: N/A