ERIC Number: EJ1090912
Record Type: Journal
Publication Date: 2016-Mar
Abstractor: As Provided
Reference Count: N/A
Utilizing Multifaceted Rasch Measurement through Facets to Evaluate Science Education Data Sets Composed of Judges, Respondents, and Rating Scale Items: An Exemplar Utilizing the Elementary Science Teaching Analysis Matrix Instrument
Boone, William J.; Townsend, J. Scott; Staver, John R.
Science Education, v100 n2 p221-238 Mar 2016
When collecting data, science education researchers frequently have multiple respondents evaluate multiple artifacts using multiple criteria. Herein, the authors introduce Multifaceted Rasch Measurement (MFRM) analysis and explain why MFRM must be used when "judges'" data are collected. The authors use data from elementary science methods students enrolled in a senior-level, semester-length course. Acting as judges, students used the 23-item Elementary Science Teaching Analysis Matrix (ESTAM) instrument to evaluate five separate science lessons taught by five different teachers. Our MFRM analysis documents that multiple judges need not act as identical robots. Rather, differences in judges' severity can be computed and corrections made in an analysis to take into consideration differing judge severity. This paper extends the current literature in "Science Education" regarding the application of Rasch measurement.
Descriptors: Evaluation Methods, Elementary School Science, Methods Courses, Preservice Teacher Education, Elementary School Teachers, Science Teachers, Rating Scales, Judges, Science Instruction
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Education; Higher Education; Postsecondary Education
Authoring Institution: N/A