All 50 states use observations to evaluate practicing teachers, but we know little about how administrators actually reason when they use those observation protocols. Drawing on think-aloud and stimulated recall data, this study describes the types of strategies and warrants practicing administrators used when rating with their district's…

The present study investigated the convergent validity of the Instructional Learning Opportunities Guidance System (MyiLOGS; Kurz and Elliott 2012), a teacher self-report log designed to measure students' opportunity to learn (OTL) the intended curriculum. MyiLOGS is compared to the Classroom Strategies Assessment System--Observer Form (CSAS-O;…

This paper reports the main findings of a study that sought to understand how teachers and department heads perceived and experienced the implementation of a classroom observation system in a teacher evaluation context. The data was collected through a teacher and department head survey and interviews with department heads who were responsible for…

Classroom observations have been increasingly used for teacher evaluations, and it is important to examine the measurement quality and the use of observation ratings. When a teacher is observed in multiple classrooms, his or her observation ratings may vary across classrooms. In that case, using ratings from one classroom per teacher may not be…

This study investigates the degree to which grades based solely on constructed-response (CR) questions differ from grades based solely on multiple-choice (MC) questions. If CR questions are to justify their higher costs, they should produce different grade outcomes than MC questions. We use a data set composed of thousands of observations on…

Promising research on the teaching and learning impact of classroom-embedded formative assessment has spawned interest in a broader array of assessment tools and practices, including interim assessment. Although researchers have begun to explore the impact of interim assessments in the classroom, like other assessment tools and practices, they…

This paper presents observations on the nature of school audit methods in light of the implementation of Scotland's incoming Curriculum for Excellence and the major normative, technological, and cultural changes affecting schools. It points to a mismatch between the concepts and structures of the incoming curriculum and that of the universalistic…