ERIC Number: ED383724
Record Type: Non-Journal
Publication Date: 1993-Dec
Pages: 30
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Multimethod Construct Validation of the Test of Spoken English. Report 46.
Boldt, Robert F.; Oltman, Philip K.
Administration of the Test of Spoken English (TSE) yields tapes of oral performance on items within six sections of the test. Trained scorers subsequently rate responses using four proficiency scales: pronunciation, grammar, fluency, and overall comprehensibility. This project examined the consistency of statistical relations among TSE scores with the measurement constructs these scores purport to reflect by examining dimensions underlying the scores. Multidimensional scaling analyses revealed that three-dimensional solutions fit the scale intercorrelations with low stress values and that the coordinates of the scales fell into three clusters in three-dimensional space, those clusters being defined primarily by test section rather than by proficiency scales. An exploratory factor analysis revealed that a single dimension dominated the variation of the 18 section-scale scores. However, when tapes for the scale scores with substantial discrepancies were rerated, agreement between the order of original and rerated scale scores far exceeded chance. This indicated that raters were able to modify their judgments according to the scale being rated. Subsequent exploratory factor analysis indicated that both section and scale factors contribute to score variation. The factors were highly correlated, and the predominance of the single factor in the exploratory analysis was seen as arising from those correlations. Six tables present analysis results. (Contains 12 references.) (Author/SLD)
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Educational Testing Service, Princeton, NJ.
Grant or Contract Numbers: N/A


