NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED458241
Record Type: Non-Journal
Publication Date: 2001-Apr
Pages: 17
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
The Score Reliability of the Test of Spoken English (TSE) from the Generalizability Theory Perspective: Validating the Current Procedure.
Lee, Yong-Won; Golub-Smith, Marna; Payton, Carmen; Carey, Jill
This study investigated the validity of the current reliability estimation procedure for the Test of Spoken English (TSE), a tape-mediated semi-performance test of 12 speaking tasks, from the perspective of generalizability theory and examined the feasibility of shortening the test without compromising the psychometric quality of the test. Data were ratings from 2 TSE administrations: (1) ratings assigned by 80 raters for 1,766 test takers; and (2) ratings given by 81 raters for 1,563 examinees. The results provide useful information to the TSE program about the minimal number of items required for a shorter version of the TSE. The current TSE score reliability estimation procedure seems to be working well for the full 12-item test, providing more conservative estimates of test score reliability than the other coefficients examined. From a generalizability theory perspective, it appeared that a high score reliability could still be maintained if the test were reduced to 9 to 10 items. (Contains 3 tables, 4 figures, and 11 references.) (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A