ERIC Number: EJ1168817
Record Type: Journal
Publication Date: 2017
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2161-4210
EISSN: N/A
A Multidisciplinary Assessment of Faculty Accuracy and Reliability with Bloom's Taxonomy
Welch, Adam C.; Karpen, Samuel C.; Cross, L. Brian; LeBlanc, Brandie N.
Research & Practice in Assessment, v12 p96-105 Win 2017
The aims of this study were to determine faculty's ability to accurately and reliably categorize exam questions using Bloom's Taxonomy, and if modified versions would improve the accuracy and reliability. Faculty experience and affiliation with a health sciences discipline were also considered. Faculty at one university were asked to categorize 30 sample exam questions using either Bloom's Taxonomy or one of two modified versions of Bloom's Taxonomy. Overall accuracy improved when a modified version of Bloom's Taxonomy was used. Collapsing the six categories of Bloom's into three (knowledge; comprehension and application; analysis, synthesis, and evaluation) showed higher levels of accuracy than when each category was collapsed with its neighbor. There was no difference between health science and nonhealth science faculty in accuracy. Overall interrater reliability was low regardless of experience or health science affiliation.
Descriptors: College Faculty, Medical School Faculty, Health Sciences, Test Items, Taxonomy, Accuracy, Reliability, Alternative Assessment, Interrater Reliability, Teacher Surveys, Statistical Analysis, Interdisciplinary Approach
Virginia Assessment Group. Tel: 504-314-2898; Fax: 504-247-1232; e-mail: editor@rpajournal.com; Web site: http://www.rpajournal.com/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Tennessee
Grant or Contract Numbers: N/A