ERIC Number: ED334226
Record Type: RIE
Publication Date: 1991-Apr
Reference Count: N/A
A Method for Improving Tasks on Performance Assessments through Field Testing.
Kenyon, Dorry Mann; Stansfield, Charles W.
One aspect of the development of a performance assessment is addressed--the field testing of the tasks. In a performance-based assessment, the tasks must allow each examinee a fair and equal opportunity to give the best possible demonstration of his or her ability, and must elicit a performance sample that enables scorers to evaluate each examinee adequately. A method of field testing is proposed that collects information via two supplemental instruments administered during the field test: (1) one completed by examinees; and (2) one completed by the field test raters. Each instrument produces quantitative data via machine-readable response forms and qualitative data via written comments. The method is illustrated by field testing four parallel forms in French and Spanish of the Texas Oral Proficiency Test, a performance-based assessment for certification of Spanish, French, and bilingual education teachers in Texas. The field test involved 160 examinees and eight raters. The use of the two instruments during field testing allows both examinees and raters to identify poorly functioning items on a performance-based assessment. This method, which encourages examinees and raters to provide focused written feedback, enables both to be involved in test development and improvement. Three tables present data, and an appendix provides the supplemental data collection forms. (SLD)
Descriptors: Bilingual Teachers, College Students, Data Collection, Educational Assessment, Field Tests, French, Higher Education, Language Tests, Licensing Examinations (Professions), Performance, Performance Based Assessment, Qualitative Research, Second Language Learning, Spanish, Standardized Tests, Teacher Certification, Test Construction
Center for Applied Linguistics, 3520 Prospect St., NW, Washington, DC 20007 (price varies).
Publication Type: Reports - Evaluative; Speeches/Meeting Papers; Tests/Questionnaires
Education Level: N/A
Authoring Institution: N/A
Identifiers: Texas Oral Proficiency Test
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, April 4-6, 1991).