Offers recommendations for the conduct of practice analysis (i.e., job analysis) concerning these issues: (1) selecting a method of practice analysis; (2) developing rating scales; (3) determining the content of test plans; (4) using multi-variate procedures for structuring test plans; and (5) determining topic weights for test plans. (SLD)

Nine productive ways of identifying a research topic are listed for the benefit of beginning researchers, and these approaches are illustrated with examples from the field of educational measurement. Having a research agenda helps the beginning investigator in this era in which there is a gold mine of data available. (SLD)

This National Council on Measurement in Education module describes standard setting for achievement measures used in education, licensure, and certification. The purposes, design, and conduct of standard-setting procedures are reviewed, and ways to calculate a cutting score are demonstrated. A self-test and annotated bibliography are included.…

The first of a series of quizzes on types of derived scores concerns interpreting grade-equivalent (GE) scores. The true-false items require a response about whether the stated interpretation of the GE score is sound. An answer key explains specific scoring methods. (CM)

This instructional module presents and illustrates rules for designing performance assessments in a step-by-step strategy through: (1) reason for the assessment; (2) type of performance evaluated; (3) exercises to elicit performance; and (4) systematic rating procedures. Guidelines for maximizing reliability, validity, and economy are presented.…

This instructional module discusses the one-, two-, and three-parameter logistic item response theory (IRT) models. Mathematical formulas are given for each model and they are compared, with figures illustrating the effects of changing parameters. A single data set is used to demonstrate the effects of changing parameter values. (SLD)

How criterion-referenced tests can be used in program and curriculum evaluations is discussed. Topics include: understanding program/curriculum environments, determining an appropriate evaluation model, and standards for determining a CRT's and an evaluation's quality. Five instructional steps are outlined, and an annotated bibliography and a…

This article presents a model that can be used by local school districts for reanalyzing standardized test results to obtain a more valid assessment of local learning objectives can be used to identify strengths/weaknesses of existing programs as well as individual students. (EGS)

The accuracy issues involved in detecting student writing skill deficiencies, factors to be dealt with or controlled, and procedural and statistical methods for controlling these factors are the focus of this article. The accuracy needed for effective instructional planning requires stability in writing assessment programs. (DWH)

This article describes a number of problems every educational measurement specialist should be prepared to confront before using microcomputers to support test-related activities, including problems with hardware, with software, and with implementing a system. It concludes with a checklist for planning a microcomputer application. (BW)

This quiz and its explanations are designed to help teachers and counselors assist students in deciding the meaning of their scores on the Scholastic Aptitude Test and the American College Test. (BW)

Percentile scores appear to be the easiest standardized test scores for parents to understand. Yet in this true-false test, Hills reveals commonly held misconceptions about percentile score reports. (LC)

This training module is intended to clarify the notion of portfolio assessment and help users design such assessments. The rationale for assessment alternatives is presented; and portfolio definitions, characteristics, pitfalls, and design considerations are reviewed. The use of portfolios in large-scale assessments is particularly demanding of…

This National Council on Measurement in Education (NCME) instructional module compares classical test theory and item response theory and describes their applications in test development. Related concepts, models, and methods are explored; and advantages and disadvantages of each framework are reviewed. (SLD)

The National Council on Measurement in Education has adopted this code to promote professionally responsible practice in educational measurement. The code enumerates professional responsibilities in eight major areas of assessment activity, from assessment development through evaluation and research. (SLD)