NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1135798
Record Type: Journal
Publication Date: 2017
Pages: 16
Abstractor: As Provided
ISSN: ISSN-1934-5747
The Impact of Item Dependency on the Efficiency of Testing and Reliability of Student Scores from a Computer Adaptive Assessment of Reading Comprehension
Petscher, Yaacov; Foorman, Barbara R.; Truckenmiller, Adrea J.
Journal of Research on Educational Effectiveness, v10 n2 p408-423 2017
The objective of the present study was to evaluate the extent to which students who took a computer adaptive test of reading comprehension accounting for testlet effects were administered fewer passages and had a more precise estimate of their reading comprehension ability compared to students in the control condition. A randomized controlled trial was used whereby 529 students in Grades 4-8 and 10 were randomly assigned to one of two conditions, both of whom took a computerized adaptive assessment of reading comprehension. Participants in the experimental condition had ability scores estimated as a function of an item response model, which accounted for item-dependence effects in the reading assessment, whereas control students took a version where item-dependence effects were not controlled. Results indicated that examinees in the experimental condition took fewer passages (average Hedges' "g" = 0.97) and had more reliable estimates of their reading comprehension ability (average Hedges' "g" = 0.60). Findings are discussed in the context of potential time savings in assessment practices without sacrificing reliability.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 4; Intermediate Grades; Elementary Education; Grade 5; Middle Schools; Grade 6; Grade 7; Junior High Schools; Secondary Education; Grade 8; Grade 10; High Schools
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD) (NIH)
Authoring Institution: N/A
Identifiers - Location: Florida
Identifiers - Assessments and Surveys: Florida Comprehensive Assessment Test
IES Funded: Yes
Grant or Contract Numbers: R305A100301; R305F100005; P50HD052120