NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1024939
Record Type: Journal
Publication Date: 2014
Pages: 18
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0895-7347
EISSN: N/A
Sensitivity of Achievement Estimation to Conditioning Model Misclassification
Rutkowski, Leslie
Applied Measurement in Education, v27 n2 p115-132 2014
Large-scale assessment programs such as the National Assessment of Educational Progress (NAEP), Trends in International Mathematics and Science Study (TIMSS), and Programme for International Student Assessment (PISA) use a sophisticated assessment administration design called matrix sampling that minimizes the testing burden on individual students. Under a matrix sampling approach, not every examinee is administered every item, which poses currently intractable challenges to estimating individual achievement. Instead, population achievement is estimated via a latent regression approach that uses item responses and a vector of examinee background information (e.g., gender and ethnicity). This vector of covariates, used in an imputation model (more commonly called a conditioning model), is assumed to be fully measured, without error. Using simulated data that follows typical large-scale assessment designs, this article provides some evidence that departures from this assumption can have a meaningful impact on conditioning model parameter estimates, subpopulation achievement estimates, and under- or over-estimates of subpopulation differences. Findings from this study indicate that the severity of parameter estimate bias depends on the measurement error mechanism and the generating ability distribution. Policy implications and impediments to detecting the impact of measurement error are briefly discussed.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Grade 8; Middle Schools; Junior High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress; Program for International Student Assessment; Progress in International Reading Literacy Study; Trends in International Mathematics and Science Study
Grant or Contract Numbers: N/A