ERIC Number: EJ1184946
Record Type: Journal
Publication Date: 2018
Pages: 25
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1933-4850
EISSN: N/A
Making Better Tests with the Rasch Measurement Model
Karlin, Omar; Karlin, Sayaka
InSight: A Journal of Scholarly Teaching, v13 p76-100 2018
This study had two aims. The first was to explain the process of using the Rasch measurement model to validate tests in an easy-to-understand way for those unfamiliar with the Rasch measurement model. The second was to validate two final exams with several shared items. The exams were given to two groups of students with slightly differing English listening proficiency. The two exams, a low-advanced and a high-advanced exam, were given to 76 and 45 Japanese university students, respectively. Each exam had 56 questions with 26 shared questions linking the two exams. After conducting a simple Rasch analysis, it was determined that up to 33 questions needed to be modified or deleted from subsequent versions of the exam. The unexpected number of recommended modifications and deletions suggests that, even for experienced teachers, the Rasch measurement model can be of tremendous value by offering greater precision in the assessment of students, as well as greater assistance in the validation of tests.
Descriptors: Item Response Theory, Test Validity, Test Items, Accuracy, Student Evaluation, College Students, Foreign Countries, Advanced Students, English (Second Language), Second Language Learning, Language Tests, Computer Software, Statistical Analysis, Difficulty Level, Scores
Park University, Center for Excellence in Teaching and Learning. 8700 NW River Park Drive, Parkville, MO 64152. Tel: 816-584-6770; Fax: 308-224-3493; e-mail: cetl@park.edu; Web site: http://www.insightjournal.net/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan (Tokyo)
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A