ERIC Number: ED336408
Record Type: RIE
Publication Date: 1991-Jun
Reference Count: N/A
Criterion Validation of a Written Multiple-Choice Test of Spanish/English Bilingual Skills.
Doyle, Teresa F.; Lin, Thung-Rung
Supervisory performance appraisals may be of limited utility in the validation of bilingual tests because incumbents are often hired to be the only employee in a unit who possesses the skills necessary to do the job. In an effort to provide criterion-related validity for four equivalent forms of a Spanish/English bilingual test for school district employees, 63 volunteer employees in a large metropolitan school district, who received a pay differential for bilingual skills, were asked to translate, free-form, a passage into written Spanish from written English. This same passage was subsequently included as part of a multiple-choice test in which the examinees selected the correct translations of sentences or phrases from among four options presented to them. The free-form translations were scored by four subject-matter experts (SMEs) using a holistic scoring method developed by E. M. White (1986) and R. A. Honey (1990). SME scores were then averaged and correlated with the objective test scores for each volunteer. The relationship between objective test scores and holistic evaluations was used to establish a passing point for the objective tests. The strength of the relationship observed between the objective test scores and raters' evaluations supports the conclusion that the holistic scoring of translations can serve as an adequate validation method for the objective test. One figure and three tables present study data. An appendix contains the holistic scoring guide. (Author/SLD)
Descriptors: Adults, Bilingual Teachers, Bilingualism, English, Holistic Evaluation, Job Performance, Language Tests, Multiple Choice Tests, Objective Tests, Occupational Tests, Predictive Validity, School Personnel, Scoring, Spanish, Spanish Speaking, Test Format, Test Validity, Translation, Written Language
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Validation Verification and Testing Techniques
Note: Paper presented at the Annual Conference of the International Personnel Management Association Assessment Council (15th, June 26, 1991).