ERIC Number: EJ1024068
Record Type: Journal
Publication Date: 2013
Abstractor: As Provided
Refining Methods for Estimating Critical Values for an Alignment Index
Polikoff, Morgan S.; Fulmer, Gavin W.
Journal of Research on Educational Effectiveness, v6 n4 p380-395 2013
The alignment among standards, assessments, and teachers' instruction is an essential element of standards-based educational reforms. The Surveys of Enacted Curriculum (SEC) is the only common tool that can be used to measure the alignment among all three of these sources (Martone & Sireci, 2009). Prior SEC alignment work has been limited by not allowing for significance tests. A recent article (Fulmer, 2011) provided a first attempt to address this shortcoming of the SEC, but that work was limited in several ways. We extend Fulmer's simulation approach by accounting for important elements of the SEC procedures, including the proper framework size, number of standards and assessment points, number of raters, rater cell-splitting rates, and rater agreement results. The results indicate that inferences about relative alignment may be heavily influenced by features of the alignment procedures. Thus, our method should be broadly applied to future SEC alignment investigations.
Descriptors: Alignment (Education), Academic Standards, Educational Assessment, Instruction, Curriculum Design, Evaluators, Educational Legislation, Federal Legislation, Measures (Individuals), Surveys, Interrater Reliability, Simulation
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Reports - Research; Journal Articles
Education Level: Grade 4; Grade 8; Elementary Education; Middle Schools; Intermediate Grades; Junior High Schools
Authoring Institution: N/A
Identifiers - Laws, Policies, & Programs: No Child Left Behind Act 2001