NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ875313
Record Type: Journal
Publication Date: 2010
Pages: 21
Abstractor: As Provided
Reference Count: 27
ISSN: ISSN-1543-4303
An Alternative Decision-Making Procedure for Performance Assessments: Using the Multifaceted Rash Model to Generate Cut Estimates
Kozaki, Yoko
Language Assessment Quarterly, v7 n1 p75-95 2010
This article describes an alternative approach to setting standards for performance assessments. The procedure was designed for use in low-budget, relatively low-stakes contexts where it is not possible to bring expert judges together. The procedure that allowed participant judges to work individually throughout the process was an effort to compensate for the lack of face-to-face interactions between judges. The viability of the proposed procedure in generating workable cut estimates was examined via its application to a certification examination in medical translation. Data were collected from a case study conducted by Kozaki (2004) and its replication, which were linked together by the Multifaceted Rasch Model into a single frame of reference. The results showed that the judges' intentions were overall well represented in the generated cut estimates and that the decision making was realistic. It is suggested that the proposed procedure should offer a viable alternative in relatively low-stakes environments to full-fledged standard-setting procedures and that thus it may be of benefit to examiners who need principled approaches to setting cut estimates for performance assessments with constrained budgets. (Contains 10 tables, 3 figures, and 4 footnotes.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan