ERIC Number: EJ1110006
Record Type: Journal
Publication Date: 2013-Sep
Pages: 33
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Assessing the Test Information Function and Differential Item Functioning for the "TOEFL Junior"® Standard Test. Research Report. ETS RR-13-17. "TOEFL Junior"® Research Report. TOEFL JR-01
Young, John W.; Morgan, Rick; Rybinski, Paul; Steinberg, Jonathan; Wang, Yuan
ETS Research Report Series, Sep 2013
The "TOEFL Junior"® Standard Test is an assessment that measures the degree to which middle school-aged students learning English as a second language have attained proficiency in the academic and social English skills representative of English-medium instructional environments. The assessment measures skills in three areas: listening comprehension, language form and meaning, and reading comprehension. This study focused on two specific psychometric characteristics of the assessment: (a) For which segments of its score scales does the assessment provide sufficient information to support the use of the scores in placement decisions? (b) Do items exhibit significant (or C-level) differential item functioning (DIF) when comparisons are made between test-takers from different countries? For the first question, both of the forms we analyzed appear to provide sufficient information to support placement decisions across the majority of the score scale for all 3 sections of the assessment. For the second question, we found that a moderate number of items exhibited significant DIF, while the linguistic analyses conducted on the DIF results showed plausible construct-relevant explanations for most of the findings.
Descriptors: Item Response Theory, Test Items, Language Tests, Second Language Learning, English (Second Language), Middle School Students, Language Proficiency, Academic Discourse, Interpersonal Competence, Listening Comprehension, Grammar, Semantics, Reading Comprehension, Psychometrics, Scores, Student Placement, Decision Making, Meta Analysis, Difficulty Level, Statistical Analysis, Cross Cultural Studies, Graphs, Foreign Countries, Comparative Analysis, Qualitative Research
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Middle Schools; Secondary Education; Junior High Schools
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: France; Greece; South Korea; Vietnam
Identifiers - Assessments and Surveys: Test of English as a Foreign Language
Grant or Contract Numbers: N/A