The ability of regression discontinuity (RD) designs to provide an unbiased treatment effect while overcoming the ethical concerns plagued by Random Control Trials (RCTs) make it a valuable and useful approach in education evaluation. RD is the only explicitly recognized quasi-experimental approach identified by the Institute of Education…

Clustered data (e.g., students within schools) are often analyzed in educational research where data are naturally nested. As a consequence, multilevel modeling (MLM) has commonly been used to study the contextual or group-level (e.g., school) effects on individual outcomes. The current study investigates the use of an alternative procedure to…

Often it is infeasible or unethical to use random assignment in educational settings to study important constructs and questions. Hence, educational research often uses observational data, such as large-scale secondary data sets and state and school district data, and quasi-experimental designs. One method of reducing selection bias in estimations…

Kingston and Nash (2011) recently presented a meta-analysis of studies showing that the effect of formative assessment on K-12 student achievement may not be as robust as widely believed. This investigation analyzes the methodology used in the Kingston and Nash meta-analysis and provides further analyses of the studies included in the study. These…

The uses and methodology of factor analysis are widely debated and discussed, especially the issues of rotational use, methods of confirmatory factor analysis, and adequate sample size. The variety of perspectives and often conflicting opinions can lead to confusion among researchers about best practices for using factor analysis. The focus of the…

A commonly advocated best practice for classroom assessment is to make the assessments authentic. Authentic is often used as meaning the mirroring of real-world tasks or expectations. There is no consensus, however, in the actual definition of the term or the characteristics of an authentic classroom assessment. Sometimes, the realistic component…

This study shows the extent to which effect size is reported and discussed in four major journals. A series of judgments about different aspects of effect size were conducted for 417 articles from four journals. Results suggest that while the reporting of simple effect size indices is more prevalent, substantive discussions of the meaning of…

Power computations for one-level experimental designs that assume simple random samples are greatly facilitated by power tables such as those presented in Cohen's book about statistical power analysis. However, in education and the social sciences experimental designs have naturally nested structures and multilevel models are needed to compute the…

Following an exploratory factor analysis, factor scores may be computed and used in subsequent analyses. Factor scores are composite variables which provide information about an individual's placement on the factor(s). This article discusses popular methods to create factor scores under two different classes: refined and non-refined. Strengths and…

This document consists of papers published in the electronic journal "Practical Assessment, Research & Evaluation" during 2000-2001: (1) "Advantages of Hierarchical Linear Modeling" (Jason W. Osborne); (2) "Prediction in Multiple Regression" (Jason W. Osborne); (3) Scoring Rubrics: What, When, and How?" (Barbara M. Moskal); (4) "Organizational…

Suggests the routine use of replications in field studies, pointing out that it is usually possible to synthesize replications quantitatively using meta-analysis. Makes the c ase that this is especially attractive for investigators whose research paradigm choices are limited in the field environment. (SLD)

Describes some of the problems in communicating educational research findings to a general audience and provides helpful information on how researchers can best present data on educational practices that work and those that don't. The needs of the audience should be the primary focus in such reports. (SLD)

This document consists of articles 23 through 26 published in the electronic journal "Practical Assessment, Research & Evaluation" in 2001: (23) "Effects of Removing the Time Limit on First and Second Language Intelligence Test Performance" (Jennifer Mullane and Stuart J. McKelvie); (24) "Consequences of (Mis)use of the Texas Assessment of…

This document consists of articles 1 through 14 of volume 6 of "Practical Assessment, Research & Evaluation": (1) "Seven Myths about Literacy in the United States" (Jeff McQuillan); (2) "Implementing Performance Assessment in the Classroom" (Amy Brualdi); (3) "Some Evaluation Questions" (William Shadish); (4) "Item Banking" (Lawrence Rudner); (5)…

This document consists of the first 10 articles of volume 8 of the electronic journal "Practical Assessment, Research & Evaluation" published in 2002-2003: (1) "Using Electronic Surveys: Advice from Survey Professionals" (David M. Shannon, Todd E. Johnson, Shelby Searcy, and Alan Lott); (2) "Four Assumptions of Multiple Regression That Researchers…