NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ933665
Record Type: Journal
Publication Date: 2009-May
Pages: 9
Abstractor: As Provided
Reference Count: 12
ISSN: ISSN-1531-7714
Combining Dual Scaling with Semi-Structured Interviews to Interpret Rating Differences
Childs, Ruth A.; Ram, Anita; Xu, Yunmei
Practical Assessment, Research & Evaluation, v14 n11 May 2009
Dual scaling, a variation of multidimensional scaling, can reveal the dimensions underlying scores, such as raters' judgments. This study illustrates the use of a dual scaling analysis with semi-structured interviews of raters to investigate the differences among the raters as captured by the dimensions. Thirty applications to a one-year post-Bachelor's degree teacher education program were rated by nine teacher educators. Eight of the raters were subsequently interviewed about how they rated the responses. A three-dimensional model was found to explain most of the variance in the ratings for two of the questions and a two-dimensional model was most interpretable for the third question. The interviews suggested that the dimensions reflected, in addition to differences in raters' stringency, differences in their beliefs about their roles as raters and about the types of insights that were required of applicants. (Contains 1 figure and 1 table.)
Dr. Lawrence M. Rudner. e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A