Implementing a randomized controlled trial design, the present study investigated the effects of two types of accommodations, linguistic modification and a glossary, for English learners (ELs) taking a computer-based mathematics assessment. Process data including response time and clicks on glossary words were also examined to better interpret…

In this paper, we report an exploratory investigation of the types of assessment in a variety of high school subjects that best predicted subsequent success at university in those subjects. In social sciences and the humanities, internal (school-based) assessment was a better predictor of university success than external, examination-based…

The study examines reliability and validity evidence of observational systems for evaluating teacher effectiveness and fostering professional development conversations in schools. Specifically, this study compared the Framework for Teaching's (FFT) validity evidence using the traditional scoring approach with a new composite scoring approach that…

This systematic review examines empirical research about students' motivation for NAEP in grades 4, 8, and 12 using multiple motivation constructs, including effort, value, and expectancy. Analyses yielded several findings. First, there are stark differences in the perceived importance of doing well on NAEP among students in grades 4 (86%), 8…

Deep science understanding is reflected in students' ability to use content and skills when making sense of the world. Assessing deep understanding requires measuring complex constructs that combine elements of content and skills. To develop valid measures of complex constructs, we need to understand how their theoretical dimensionality, reflected…

In this study (n = 5037) we further investigated the construct validity of the Georgia Brief School Climate Inventory (GBS). Despite containing ordinal items (e.g., ordered-responses), the GBS has only been examined using linear approaches. To fill this void, we employed confirmatory item factor analysis (IFA) to examine the factor structure…

This meta-analytic path analysis presents evidence that first-year academic performance (FYAP), measured by first-year grade point average (FYGPA) plays the major role in determining second-year student retention and that socioeconomic status (SES), measured by parental income, plays a negligible role. Based on large sample data used in a previous…

There is currently a lack of instrumentation with sufficient technical quality focused on the implementation of classroom formative assessment at a grain-size appropriate for the provision of feedback to teachers and program developers. This paper details the development of a validity argument for the High-Impact Classroom Assessment Practices…

Assessments of teacher content knowledge are increasingly designed to provide evidence of the content knowledge needed to carry out the moment-to-moment work of teaching. Often these assessments focus on content knowledge only used in teaching with the goal of testing types of professional content knowledge. In this paper, we argue that while this…

We describe the conceptualization, design, development, validation, and testing of a summative instrument that measures high school students' ability to analyze and evaluate data, construct scientific explanations, and formulate scientific arguments in biology and chemistry disciplinary contexts. Data from 1,405 students were analyzed to evaluate…

The need and desire to understand and adopt formative assessment practices remain high on the agenda at all levels of educational systems around the world. To advance teachers' use of formative assessment, research attention also needs to be paid to (a) understanding the challenges teachers face when asked to utilize formative assessment practices…

The State of Washington requires school districts to file court petitions on students with excessive unexcused absences. The "Washington Assessment of Risks and Needs of Students" (WARNS), a self-report screening instrument developed for use by high school and juvenile court personnel in such situations, purports to measure six facets of…

High-quality measures of instructional practice are essential for research and evaluation of innovative instructional policies and programs. However, existing measures have generally proven inadequate because of cost and validity issues. This paper addresses two potential drawbacks of survey self-report measures: variation in teachers'…

As states evaluate whether they should continue with their current assessment program or adopt next-generation college readiness assessments, it is important to ascertain the degree to which current high school assessments can be used for college readiness interpretations. In this study, we examined the ability of a state assessment to serve as an…

Students may not fully demonstrate their knowledge and skills on accountability tests if there are no stakes attached to individual performance. In that case, assessment results may not accurately reflect student achievement, so the validity of score interpretations and uses suffers. For this study, matched samples of students taking state…