ERIC Number: ED223110
Record Type: RIE
Publication Date: 1981
Reference Count: N/A
Inter-rater and Intra-rater Reliability of the Oral Interview and Concurrent Validity with Cloze Procedure.
Partial results are presented of a study investigating the relationship between an oral interview and a cloze test in Hebrew and focusing on issues related to the oral interview procedure. An oral interview speaking test and cloze tests were administered to 106 students of Hebrew at the University of Minnesota. The taped interviews were rated by three raters on vocabulary, grammar, pronunciation, fluency, and overall speaking proficiency. Inter-rater and intra-rater reliabilities and concurrent validity of the oral interviews with the cloze tests were calculated. Very close agreement was found among the three raters on the oral interviews; correlations between two ratings of the oral interview by each rater were high for grammar, vocabulary, and fluency, and lower for pronunciation. Significantly high correlations were found between the average oral interview ratings and each of the cloze test scores. The common variance, a measure of how well performance on one test can predict performance on the other, was high between the oral interview total score and the difficult cloze acceptable score. While many aspects of the oral interview procedure in Hebrew remain to be investigated, the use of the oral interview for testing speaking proficiency in Hebrew is recommended. (Author/AMH)
Descriptors: Cloze Procedure, Hebrew, Higher Education, Interviews, Language Proficiency, Language Research, Language Tests, Second Language Learning, Speech Tests, Test Validity
Not available separately; see FL 013 318.
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: N/A
Note: In its: The Construct Validation of Tests of Communicative Competence.