Increasing linguistic diversity in classrooms has led researchers to examine the validity and fairness of standardized achievement tests, specifically concerning whether test score interpretations are free of bias and score use is fair for all students. This study examined whether mathematics achievement test items that contain complex language…

The indirect effect of perceived test importance on test performance via examinee effort is often modeled using importance and effort scores measured "after" test completion, which does not align with their theoretical temporal ordering. These retrospectively measured scores may be influenced by examinees' test performance. To…

In this study (n = 5037) we further investigated the construct validity of the Georgia Brief School Climate Inventory (GBS). Despite containing ordinal items (e.g., ordered-responses), the GBS has only been examined using linear approaches. To fill this void, we employed confirmatory item factor analysis (IFA) to examine the factor structure…

Today, postsecondary institutions in the US typically wish to enroll entering classes that are both academically qualified and diverse. Although the definition of diversity varies from school to school, the challenge is essentially the same: How can academic objectives be combined with goals that involve the composition of the entering class? Many…

This meta-analytic path analysis presents evidence that first-year academic performance (FYAP), measured by first-year grade point average (FYGPA) plays the major role in determining second-year student retention and that socioeconomic status (SES), measured by parental income, plays a negligible role. Based on large sample data used in a previous…

To promote and support teachers' professional growth in using formative assessment practices in the classroom, we developed and piloted a suite of materials which consists of a set of rubrics for ten dimensions of formative assessment and six self-reflection/peer-observation tools. We describe the iterative development process, the design…

There is currently a lack of instrumentation with sufficient technical quality focused on the implementation of classroom formative assessment at a grain-size appropriate for the provision of feedback to teachers and program developers. This paper details the development of a validity argument for the High-Impact Classroom Assessment Practices…

This paper explores ways of capturing teachers' formative assessment behaviors in Philippine classrooms through an observation tool. Early versions of the tool were structured using the 'Elicit-Student response-Recognize-Use' ESRU model. To account for the practices observed in the classroom, the observation tool was resituated to focus on Elicit…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…

This paper characterizes the ways in which increased attention to response process data has implications for psychometrics. To do so, this work draws on two organizing frameworks that have heretofore not been associated: evidence-centered design, and the distinction between greater and lesser statistics. Overlaying these frameworks leads to a…

We evaluate how higher- vs. lower-scoring middle-school students differ in their composition processes when writing persuasive essays from source materials. We examined differences on four individual process features--time taken before beginning to write, typing speed, total time spent, and number of words started. Next, we examined differences…

We investigated how item formats influence test takers' response tendencies under uncertainty. Adult participants solved content-equivalent math items in three formats: multiple-selection multiple-choice, grid with forced-choice (true-false) options, and grid with non-forced-choice options. Participants showed a greater tendency to commit (rather…

Classroom assessment and the use of student performance data to inform instructional decisions have significant potential to help students meet the learning goals of science education. Research has shown that process-oriented assessment practices are challenging and sometimes ignored aspects of teaching, partly because teachers' conceptions of…

Assessments of teacher content knowledge are increasingly designed to provide evidence of the content knowledge needed to carry out the moment-to-moment work of teaching. Often these assessments focus on content knowledge only used in teaching with the goal of testing types of professional content knowledge. In this paper, we argue that while this…

We describe the conceptualization, design, development, validation, and testing of a summative instrument that measures high school students' ability to analyze and evaluate data, construct scientific explanations, and formulate scientific arguments in biology and chemistry disciplinary contexts. Data from 1,405 students were analyzed to evaluate…