Describes a program used by two New Jersey educators to help teachers understand and use their state's standards and test specifications to improve classroom instruction and raise achievement. Suggests it is important for teachers to understand the entirety of each subject and where state test content fits within each area so that they can align…

Provides and illustrates a method to compute the expected number of misclassifications of examinees using three-parameter item response theory and two state classifications (mastery or nonmastery). The method uses the standard error and the expected examinee ability distribution. (SLD)

Suggests the routine use of replications in field studies, pointing out that it is usually possible to synthesize replications quantitatively using meta-analysis. Makes the c ase that this is especially attractive for investigators whose research paradigm choices are limited in the field environment. (SLD)

Outlines an exploratory multidimensional scaling-based approach to profile analysis called Profile Analysis via Multidimensional Scaling (PAMS) (M. Davison, 1994). The PAMS model has the advantages of being applied to samples of any size easily, classifying persons on a continuum, and using person profile index for further hypothesis studies, but…

Provides an overview of content analysis, a powerful data reduction technique. It is a systematic, replicable technique for compressing many words of text into fewer content categories based on explicit rules of coding. The technique extends far beyond simple word frequency counts, but requires careful definition of categories. (SLD)

Presents a generic rubric to assess postsecondary academic skills, describes its preliminary application in a university setting, and discusses related issues from a research point of view. The rubric was used with four graduate and two undergraduate classes (n=approximately 100 students). Interrater and intrarater aspects of reliability were…

Discusses the use of Web-based surveys and identifies several factors that influence data quality. Suggests that Web-based surveying, although very attractive, should be used with caution at present because of coverage bias or bias if sampled people do not have access to the Internet. (SLD)

Studied the stability of test anxiety over time by examining the level of reported cognitive test anxiety at three points in an academic semester. Results for 64 undergraduates show that it is practical to collect test anxiety data at times other than when a test is being completed. It does not seem necessary to collect test anxiety data prior to…

Provides an overview of the concept of alignment and the role it plays in assessment and accountability systems. Discusses some methodological issues affecting the study of alignment and explores the relationship between alignment and test score interpretation. Alignment is not only a methodological requirement but also an ethical requirement.…

Investigated the construct validity of the implied and theoretical structures of the Wechsler Adult Intelligence Scale-III (WAIS-III). Results using the standardization sample of 2,450 adults and adolescents indicate that the WAIS-III provides an excellent measure of the four-factor model and a general factor, but they do not support the construct…

Canadian postsecondary students (n=133) with moderate second-language competence took the Wonderlic Personnel Test with or without the standard time limit in English or French. Findings suggest that time accommodation can be applied to clients who are taking an intelligence test in their second language. (SLD)

Explores the consequence of failing to incorporate measurement error in the development of cut scores in criterion-referenced measures, using the example of Texas and the Texas Assessment of Academic Skills to illustrate the impact of measurement error on false negative decisions. Findings support those of W. Haney (2000). (SLD)

Provides advice on designing scoring rubrics, rating scales as opposed to checklists, for use with performance assessments. Discusses holistic and analytic rubrics, and lists the steps in rubric development. (SLD)

Describes the three most promising approaches to essay scoring by computer: (1) Project Essay Grade (PEG; E. Page, 1966); (2) Intelligent Essay Assessor (IEA; T. Landauer, 1997); and (3) E-rater (J. Burstein, Educational Testing Service). All of these proprietary systems return grades that correlate meaningfully with those of human raters. (SLD)

Introduces the problem of hierarchical, or nested, data structures and discusses how this problem is dealt with effectively. Provides examples of the pitfalls of not doing appropriate analyses. New software is making hierarchical linear modeling more user-friendly and accessible. (SLD)