Rating scale design and development for testing speaking is generally conducted using one of two approaches: the measurement-driven approach or the performance data-driven approach. The measurement-driven approach prioritizes the ordering of descriptors onto a single scale. Meaning is derived from the scaling methodology and the agreement of…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

Presents a study of how well a set of language proficiency self-ratings fit the predictions of a probabilistic measurement model known as the Rasch Model. Applies the principles of the model to scalar rather than binary item response data. Concludes that scalar analysis of this kind is feasible with self-rating data. (Author/SED)

Examines appropriacy of a nationally standardized test normed on English speakers but used with non-English speaking students. Data from the school year are analyzed via reliability comparison, exploratory factor analysis, and comparison of variances. The use of the test was statistically defensible. This finding does not address the need for…