ERIC Number: ED368183
Record Type: RIE
Publication Date: 1994-Mar
An Approach to Gain Score Dependability and Validity for Criterion-Referenced Language Tests.
Ross, Steven; Hua, Te-Fang
A general issue related to language program development involves the empirical rationalization of cut score decisions in criterion-referenced language tests. Cut score dependability focuses on the consistency of the decisions in repeated testing or the assessment of language learner performances. In this case, the issue is to determine the optimal index of gain score dependability in the pre-instruction and post-instruction approach to assessing the language learning gains. This paper examines an approach used in assessing gain score dependability in which the optimal index of gain score dependability is derived from examining the cut score dependability of the pre-instructional administration of the criterion-referenced test as well as the post-instructional criterion-referenced test, in relation to differences in the ratio of pre- and post-instruction variances. The database comes from a pre-instruction administration of a university-level academic listening test followed by a counterbalanced post-instruction administration of an alternate form of the same test after one semester of instruction. Results indicated only moderate gain score dependability, because the cut score was close to the mean proportion correct on the post-instructional test. (MDM)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Note: Paper presented at the Annual Language Testing Research Colloquium (16th, 1994).