ERIC Number: ED362041
Record Type: Non-Journal
Publication Date: 1993-Jul-9
Reference Count: N/A
Equating National Exams in Foreign Language Reading Comprehension.
Krieken, Robert van
The procedures for the construction of the Dutch national exams of reading comprehension and for setting cut-off scores have remained roughly unchanged over 20 years. Construction procedures are characterized by thorough screening rather than pretesting; cut-off scores are influenced by procedures and percentages fails rather than by equating. Two studies were carried out to demonstrate the necessity and feasibility of equating procedures using IRT methodology. The first study equated exams from 1984 to 1990 with the same old exam using section post-equating and producing differences in mean difficulty. Traditional estimates and IRT estimates lead to the same cut-off scores. The second study was part of a large scale project the Inspectorate had commissioned, investigating the equivalence of cut-off scores in 17 subjects as well as differences in populations using teachers' estimates as well as empirical data. Data were scaled using IRT methodology, producing estimates of the mean score candidates in 1991 would have made on previous exams. The first study demonstrated differences between exams and showed that estimates were robust. The second study showed that teachers' estimates were consistent, but correlate only moderately with pupils' results. (Author/JL)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Centraal Inst. voor Toetsonwikkeling, Arnhem (Netherlands).
Identifiers - Location: Netherlands