ERIC Number: EJ947506
Record Type: Journal
Publication Date: 2012
Abstractor: As Provided
Reference Count: N/A
The Matter of Assessor Variance in Early Childhood Education--Or Whose Score Is It Anyway?
Waterman, Clare; McDermott, Paul A.; Fantuzzo, John W.; Gadsden, Vivian L.
Early Childhood Research Quarterly, v27 n1 p46-54 2012
Useful assessment outcomes (as manifest through assigned scores) must show reasonable variation across children because it is that variation that presumably defines children's individual differences. Alternatively it is conceivable that some portion of the variability in assessment outcomes does not reflect child differences but rather differences in the performance of the assessors who carry out assessments. Hierarchical linear modeling is applied in this article to identify the amount of score variation attributable to assessors rather than children. Working with multiple cohorts of Head Start and kindergarten children, score variation is analyzed for measures administered outside of classrooms by extramural assessors and for teacher-administered measures within classrooms. The amount of assessor variance (vs. actual child variance) was negligible as associated with extramural assessors but substantial for teacher assessors, indicating that large portions of the variability in teacher-administered assessments have nothing to do with children's unique performances. Recommendations are provided to assist the interpretation of assessment outcomes in future research and practice. (Contains 5 tables.)
Descriptors: Early Childhood Education, Disadvantaged Youth, Kindergarten, Outcomes of Education, Individual Differences, Young Children, Evaluation, Statistical Analysis, Models, Federal Programs, Preschool Children, Low Income, School Readiness, Early Intervention, Holistic Approach, Research and Development, Theory Practice Relationship
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A