ERIC Number: EJ1071209
Record Type: Journal
Publication Date: 2015
Abstractor: As Provided
Reference Count: 53
Exploring Person Fit with an Approach Based on Multilevel Logistic Regression
Walker, A. Adrienne; Engelhard, George, Jr.
Applied Measurement in Education, v28 n4 p274-291 2015
The idea that test scores may not be valid representations of what students know, can do, and should learn next is well known. Person fit provides an important aspect of validity evidence. Person fit analyses at the individual student level are not typically conducted and person fit information is not communicated to educational stakeholders. In this study, we focus on a promising method for detecting and conveying person fit for large-scale educational assessments. This method uses multilevel logistic regression (MLR) to model the slopes of the person response functions, a potential source of person misfit for IRT models. We apply the method to a representative sample of students who took the writing section of the SAT (N = 19,341). The findings suggest that the MLR approach is useful for providing supplemental evidence of model-data fit in large-scale educational test settings. MLR can be useful for detecting general misfit at global and individual levels. However, as with other model-data fit indices, the MLR approach is limited in providing information regarding only some types of person misfit.
Descriptors: Test Validity, Goodness of Fit, Educational Assessment, Hierarchical Linear Modeling, Regression (Statistics), Item Response Theory, College Entrance Examinations
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Identifiers - Assessments and Surveys: SAT (College Admission Test)