Problems relating to existence of interval scales, dimensionality of a trait, and patterns of item response functions are approached through contrasting scaling methods: item response theory modeling and dual scaling. Similarity of the methods is established through a study of 326 female junior college students in Singapore completing a Likert…

An alternating least squares method for iteratively fitting the longitudinal reduced-rank regression model is proposed. For social and behavioral science applications, the developed algorithm does not rely on the assumption of multinomial errors and allows for scaling of input and output variables. (SLD)

Changes in information retention resulting from changes in reliability and number of intervals in scale construction were studied to provide quantitative information to help in decisions about choosing intervals. Information retention reached a maximum when the number of intervals was about 8 or more and reliability was near 1.0. (SLD)

Naturalistic and traditional social science models were used to conduct a needs assessment in which 35 stakeholders were interviewed about their perceptions of the functioning of a crisis agency and the needs of the community and the agency. Concept mapping (multidimensional scaling and hierarchical analysis) was used to establish need categories…

An expanded version of the method of content evaluation proposed by S. G. Sireci and K. F. Giesinger (1992) was evaluated with respect to a national licensure examination and a nationally standardized social studies achievement test. Two groups of 15 subject-matter experts rated the similarity and content relevance of the items. (SLD)

Out-of-level testing in state and district assessments is becoming more popular under the reauthorized Individuals with Disabilities Education Act. This practice (and use of different norm-referenced tests) confounds interdistrict comparisons and contributes to inequitable assessment practices. Proper scaling can remedy this situation. (MLH)

Native language affects the perception of segmental phonetic structure, of stress, and of semantic and pragmatic effects of intonation. Similarly, native language might influence the perception of similarities and differences among intonation contours. To test this hypothesis, a cross-language experiment was conducted. An English utterance was…

Drawing from the information presented at a conference sponsored by the Harvard Graduate School of Education and the Mid-Atlantic Regional Technology in Education Consortium, educators, researchers, and policymakers translate theory into practice to provide a hands-on resource that describes different models for scaling up success. This resource…

The presence of multiple readings of a student response to a constructed-response item in a large-scale assessment requires a procedure for combining the ratings to obtain an item score. An alternative to the averaged item ratings that are usually used is the summing of ratings for each item. This study evaluated the effect of summing as opposed…

Test developers continue to struggle with the technical and logistical problems inherent in assessing achievement across different languages. Many testing programs offer separate language versions of a test to evaluate the achievement of examinees in different language groups. However, comparison of individuals who took different language versions…

During the past 6 years, under a contract from the National Center for Education Statistics, a Technical Review Panel has overseen and conducted a series of research studies addressing a range of validity questions relevant to the various uses and interpretations of the National Assessment of Educational Progress (NAEP). Study topics included: (1)…

The following seven statistical procedures are compared in terms of the ability to recover a unidimensional latent trait from Likert-type data: (1) factor analysis based on Pearson correlations (FA-PR); (2) factor analysis based on polychoric correlations (FA-PL); (3) the graded response model in item response theory (IRT-GRM); (4) internal…

A modified regression procedure for finding a common metric for item response theory (IRT) parameter estimates and for total test scores is proposed and compared to the chi-square method of equating. The chi-square method was chosen after literature review for the currently used scaling procedures. The modification used with the regression…

The refinement and application of the School Organizational Climate Questionnaire (SOCQ), an instrument for measuring organizational climate, is described in this report. The instrument is a mechanism by which schools can direct their school improvement efforts. In two case studies, a small urban elementary and a large urban secondary school…

This study was designed as the first in a series of inquiries to investigate the use of multidimensional scaling techniques for observing and measuring underlying dimensions commonly perceived by viewers. Following a preliminary study to select photographs, 15 university students aged 19 to 45 were presented with stimuli consisting of 34 colored…