NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1064064
Record Type: Journal
Publication Date: 2015
Pages: 18
Abstractor: As Provided
Reference Count: 32
ISSN: ISSN-0895-7347
A Comparison of Teacher Effectiveness Measures Calculated Using Three Multilevel Models for Raters Effects
Murphy, Daniel L.; Beretvas, S. Natasha
Applied Measurement in Education, v28 n3 p219-236 2015
This study examines the use of cross-classified random effects models (CCrem) and cross-classified multiple membership random effects models (CCMMrem) to model rater bias and estimate teacher effectiveness. Effect estimates are compared using CTT versus item response theory (IRT) scaling methods and three models (i.e., conventional multilevel model, CCrem, CCMMrem). Results indicate that ignoring rater bias can lead to teachers being misclassified within an evaluation system. The best estimates of teacher effectiveness are produced using CCrems regardless of scaling method. Use of CCMMrems to model rater bias cannot be recommended based on the results of this study; combining the use of CCMMrems with an IRT scaling method produced especially unstable results.
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Education; Middle Schools; Secondary Education; Junior High Schools; Grade 4; Intermediate Grades; Grade 5; Grade 6; Grade 7; Grade 8
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Colorado; Florida; New York; North Carolina; Tennessee; Texas