NotesFAQContact Us
Search Tips
ERIC Number: ED431808
Record Type: Non-Journal
Publication Date: 1999-Mar-27
Pages: 19
Abstractor: N/A
Estimation of Score Distributions for TOEFL Concordance Tables.
Jiang, Hai
The purpose of this paper is to describe the techniques used in establishing the concordance tables between the Test of English as a Foreign Language (TOEFL), paper and pencil (P&P), and computer-based testing (CBT) sections and total reported score scales. Listening, reading, and composite structure and essay scores plus a total score are reported in the CBT on scales that are nonoverlapping with the P&P scales. The concordance study was conducted to make it possible to equate the CBT test to the P&P test. Examinees (n=8,387) took the CBT soon after their P&P tests. Responses from both were used to estimate the conditional distributions of the CBT section scores and the observed Essay scores, given the P&P scores. Projected population distributions were then obtained for the CBT scores and observed Essay scores. Given reference forms for the CBT, the CBT and Essay score distributions were projected to reference-test observed score distributions that then served as the basis for concordance functions. Concordance tables were successfully established between the CBT and the P&P reported score scales for TOEFL. It might be argued that the researchers could have used the study group alone to establish the concordance relationships. However, because of the self-selection of the examinees participating in the study, their P&P score distributions were clearly different from those of the population, and it was determined that more sophisticated methods needed to be employed. (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Test of English as a Foreign Language