ERIC Number: EJ1188553
Record Type: Journal
Publication Date: 2018
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2196-7822
EISSN: N/A
Student, Instructor, and Observer Agreement Regarding Frequencies of Scientific Teaching Practices Using the Measurement Instrument for Scientific Teaching-Observable (MISTO)
Durham, Mary F.; Knight, Jennifer K.; Bremers, Emily K.; DeFreece, Jameson D.; Paine, Alex R.; Couch, Brian A.
International Journal of STEM Education, v5 Article 31 2018
Background: The Scientific Teaching (ST) pedagogical framework encompasses many of the best practices recommended in the literature and highlighted in national reports. Understanding the growth and impact of ST requires instruments to accurately measure the extent to which practitioners implement ST in their courses. Researchers have typically relied on students, instructors, or observers to document course teaching practices, but it remains unclear whether and how these perspectives differ from each other. To address this issue, we modified our previously published instrument to generate the Measurement Instrument for Scientific Teaching-Observable (MISTO), which can be completed by students, instructors, and observers, and we investigated the degree of similarity between these three perspectives across 70 undergraduate science courses at seven different institutions in the USA. Results: We found that the full MISTO and Active Learning subcategory scores showed the highest correlations among the three perspectives, but the degree of correlation between perspectives varied for the other subcategories. Match scores between students and instructors were significantly higher than observer matches for the full MISTO and for the Active Learning, Inclusivity, and Responsiveness subcategories. Conclusions: We find that the level and type of agreement between perspectives varies across MISTO subcategories and that this variation likely stems from intrinsic differences in the course access and scoring decisions of the three perspectives. Building on this data, we recommend MISTO users consider their research goals, available resources, and potential artifacts that may arise when deciding which perspective best fits their needs in measuring classroom teaching practices.
Descriptors: Science Instruction, Teaching Models, Interrater Reliability, Measures (Individuals), Undergraduate Students, College Faculty, College Science, Teaching Methods
Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: DUE1323019