ERIC Number: EJ1109292
Record Type: Journal
Publication Date: 2014-Dec
Pages: 81
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2330-8516
EISSN: N/A
Improving Content Assessment for English Language Learners: Studies of the Linguistic Modification of Test Items. Research Report. ETS RR-14-23
Young, John W.; King, Teresa C.; Hauck, Maurice Cogan; Ginsburgh, Mitchell; Kotloff, Lauren; Cabrera, Julio; Cavalie, Carlos
ETS Research Report Series, Dec 2014
This article describes two research studies conducted on the linguistic modification of test items from K-12 content assessments. In the first study, 120 linguistically modified test items in mathematics and science taken by fourth and sixth graders were found to have a wide range of outcomes for English language learners (ELLs) and non-ELLs, with regard to performance on the original and modified versions of the same items. The original items were disclosed items from two states and were used in their standards-based assessments.The modified versions of these items were developed by a team of Educational Testing Service (ETS) assessment developers and researchers. The ETS research team identified several kinds of modifications that appeared promising and applied the modifications systematically. Ideally, modifying items leads to improved performance by ELLs while having little to no impact on the performance of non-ELLs. However, both groups of students performed better on some items, about the same on some other items, and worse on yet some other items. Cognitive interviews were conducted as a follow-up study to investigate which features of the linguistically modified items produced the observed outcomes for ELLs and non-ELLs. The results from this study added little clarity with regards to which of the linguistic modifications were effective and how they improved the understanding and performance of ELLs on these content items.
Descriptors: English Language Learners, Test Items, Mathematics Tests, Science Tests, Elementary School Students, Testing Accommodations, State Standards, Test Construction, Item Analysis, Language Usage, Achievement Gap, Statistical Analysis, Student Attitudes, Cognitive Processes, Spanish Speaking, Language Tests, Language Proficiency, Interviews, Qualitative Research
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Elementary Education; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Delaware; Massachusetts; New Jersey
Grant or Contract Numbers: N/A