ERIC Number: ED217733
Record Type: RIE
Publication Date: 1981-Sep
Reference Count: N/A
Testing Oral Proficiency in Life-Like Settings: Rating Scales and Reliability.
Oral proficiency tests were constructed for French, German, and English by the Dutch National Institute for Educational Measurement to determine how well students could cope linguistically with daily living situations, after 3 years of foreign language instruction. Originally the rating scale featured six categories. Because of difficulties in scoring, the rating categories were reduced to three: (1) an intelligent and appropriate response with minor mistakes; (2) an intelligible and appropriate response, but takes some effort to understand; and (3) response is not forthcoming/not intelligible/not appropriate in the context. Categories for fluency and pronunciation were good, adequate, inadequate, and weak. Consistency of raters and agreement among them increased with the second model, except with English test-raters. Analysis of the English test assignments, answers and ratings led to conclusions and suggestions with a view to the training of raters, the construction of future tests, and the definition of criteria for assessments. Clearer definition of categories, provision for positive rating of answers that are intelligible but display some lack of knowledge of vocabulary items, and considerations of social and contextual appropriateness are all taken into consideration in a new program of instructions for raters. (AMH)
Descriptors: Achievement Rating, English (Second Language), Foreign Countries, French, German, Language Tests, Oral Language, Rating Scales, Second Language Instruction, Secondary Education, Situational Tests, Speech Communication, Test Reliability
Not available separately; see FL 013 014.
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Note: In its: Practice and Problems in Language Testing. Proceedings of the International Language Testing Symposium of the Interuniversitare Sprachtesgruppe (4th, Essex, England, September 14-17, 1981).