ERIC Number: ED409345
Record Type: Non-Journal
Publication Date: 1997-Mar
Reference Count: N/A
Generalizability of Performance Assessment Measures on the Florida Teacher Certification Examinations.
Motika, Robert T.
Data from performance measures that were part of two foreign language teacher certification examinations were used in a generalizability study of the quality of their performance ratings. A total of 775 examinees from the Spanish K-12 and 192 examinees from the French K-12 subject area tests of the Florida Teacher Certification Examinations were selected. Data groups for both examinations were subdivided by unique rater pair combinations to form a series of fully crossed designed (person x rater x scale) with two random facets (person and rater) and one fixed facet (scale). Variance component estimates were then determined for each of the 31 examinee subgroups for Spanish and 8 subgroups for French. The means of the resulting variance component estimate distributions were used to assess the overall quality of the ratings and the relative measurement error associated with rater and scale facets. Separate partially nested designs (person:form x rater) were used to estimate variance associated with the forms facet. Results indicate that for both the Spanish and French examination data, universe score or person variance represented the largest single component of the total observed variance while the magnitude of the variance component estimated for facets associated with measurement error are small. The overall quality of these data for use in decisions as assessed by estimates of the index of dependability or phi coefficient was high. An appendix contains equations for the theoretical sampling variance of variance components. (Contains 14 tables and 5 references.) (Author/SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: Florida