ERIC Number: EJ1171011
Record Type: Journal
Publication Date: 2018
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1743-727X
EISSN: N/A
Item and Testlet Position Effects in Computer-Based Alternate Assessments for Students with Disabilities
Bulut, Okan; Lei, Ming; Guo, Qi
International Journal of Research & Method in Education, v41 n2 p169-183 2018
Item positions in educational assessments are often randomized across students to prevent cheating. However, if altering item positions results in any significant impact on students' performance, it may threaten the validity of test scores. Two widely used approaches for detecting position effects -- logistic regression and hierarchical generalized linear modelling -- are often inconvenient for researchers and practitioners due to some technical and practical limitations. Therefore, this study introduced a structural equation modeling (SEM) approach for examining item and testlet position effects. The SEM approach was demonstrated using data from a computer-based alternate assessment designed for students with cognitive disabilities from three grade bands (3-5, 6-8, and high school). Item and testlet position effects were investigated in the field-test (FT) items that were received by each student at different positions. Results indicated that the difficulty of some FT items in grade bands 3-5 and 6-8 differed depending on the positions of the items on the test. Also, the overall difficulty of the field-test task in grade bands 6-8 increased as students responded to the field-test task in later positions. The SEM approach provides a flexible method for examining different types of position effects.
Descriptors: Alternative Assessment, Disabilities, Computer Assisted Testing, Structural Equation Models, Educational Assessment, Elementary School Students, Middle School Students, High School Students, Regression (Statistics), Test Items, Difficulty Level, Field Tests, Scores, Cheating, Mathematics Tests
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A