ERIC Number: EJ979679
Record Type: Journal
Publication Date: 2012
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0731-1745
EISSN: N/A
Available Date: N/A
Application of Latent Trait Models to Identifying Substantively Interesting Raters
Wolfe, Edward W.; McVay, Aaron
Educational Measurement: Issues and Practice, v31 n3 p31-37 Fall 2012
Historically, research focusing on rater characteristics and rating contexts that enable the assignment of accurate ratings and research focusing on statistical indicators of accurate ratings has been conducted by separate communities of researchers. This study demonstrates how existing latent trait modeling procedures can identify groups of raters who may be of substantive interest to those studying the experiential, cognitive, and contextual aspects of ratings. We employ two data sources in our demonstration--simulated data and data from a large-scale state-wide writing assessment. We apply latent trait models to these data to identify examples of rater leniency, centrality, inaccuracy, and differential dimensionality; and we investigate the association between rater training procedures and the manifestation of rater effects in the real data. (Contains 5 tables.)
Descriptors: Researchers, Research, Correlation, Test Bias, Item Response Theory, Raw Scores, Rating Scales, Models, Writing Evaluation
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A

Peer reviewed
Direct link
