NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ921387
Record Type: Journal
Publication Date: 2011-Apr
Pages: 16
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-1075-2935
Rating Scales for Diagnostic Assessment of Writing: What Should They Look Like and Where Should the Criteria Come from?
Knoch, Ute
Assessing Writing, v16 n2 p81-96 Apr 2011
Rating scales act as the de facto test construct in a writing assessment, although inevitably as a simplification of the construct (North, 2003). However, it is often not reported how rating scales are constructed. Unless the underlying framework of a rating scale takes some account of linguistic theory and research in the definition of proficiency, the validity of the scale will be limited (Lantolf & Frawley, 1985). In this paper, the decision-making process when designing a rating scale for diagnostic writing assessment is described. A number of considerations are discussed. These include the type of rating scale, who is going to use the rating scale, what the descriptors should look like and how the scores should be reported. The most central consideration is what the scale categories (or traits) should look like. While the literature on rating scales (e.g., Fulcher, 1987; McNamara, 2002) has called for scales to be theory-based, it is shown that none of the theories/models available for this purpose are sufficient by themselves for a scale of diagnostic writing. Several different theories and models were evaluated for the purpose of this paper, and the advantages and disadvantages of each are discussed.
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A