NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1127436
Record Type: Journal
Publication Date: 2014-Jan
Pages: 14
Abstractor: As Provided
Reference Count: 19
ISBN: N/A
ISSN: ISSN-2322-1291
The Effect of Test Specifications Review on Improving the Quality of a Test
Zandi, Hamed; Kaivanpanah, Shiva; Alavi, Seyed Mohammad
Iranian Journal of Language Teaching Research, v2 n1 p1-14 Jan 2014
Reviewing the test specifications to improve the quality of language tests may be a routine process in professional testing systems. However, there is a paucity of research about the effect of specifications review on improving the quality of small-scale tests. The purpose of the present study was twofold: how specifications review could help improve the validity of a test in the context of assessment for learning (AFL) and to what extent qualitative review of items can identify poor ones. To this end, a group of trained test specifications reviewers (No = 7) provided feedback on the specifications of a test and the quality of the items. Analysis of feedback showed that pedagogical concerns naturally emerged during the specifications review and led to concrete suggestions on how the specifications could be revised so that the resulting test could become more useful in a classroom context. Moreover, the test items were administered to a group of (No = 40) test-takers and a set of quantitative item analyses was carried out. Comparison of the results of qualitative judgment of reviewers with the quantitative analyses showed about 38% of the items suggested for revision by the reviewers were also identified as poor by the classical test theory (CTT) analysis. The findings highlight the potential of specifications review as part of the a priori validation of tests in small-scale assessments where conducting statistical analysis is not usually feasible.
Urmia University Press. Faculty of Literature and Humanities, Urmia, 165, Iran; Tel: +98-44-32752741; Fax: +98-44-32752746; e-mail: info@urmia.ac.ir; Web site: http://www.urmia.ac.ir/ijltr
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Iran