Download full text
Download full text
ERIC Number: EJ1206447
Record Type: Journal
Publication Date: 2019
Abstractor: As Provided
Graded Response Method: Does Question Type Influence the Assessment of Critical Thinking?
Fukuzawa, Sherry; deBraga, Michael
Journal of Curriculum and Teaching, v8 n1 p1-10 2019
Graded Response Method (GRM) is an alternative to multiple-choice testing where students rank options according to their relevance to the question. GRM requires discrimination and inference between statements and is a cost-effective critical thinking assessment in large courses where open-ended answers are not feasible. This study examined critical thinking assessment in GRM versus open-ended and multiple-choice questions composed from Bloom's taxonomy in an introductory undergraduate course in anthropology and archaeology (N=53 students). Critical thinking was operationalized as the ability to assess a question with evidence to support or evaluate arguments (Ennis, 1993). We predicted that students who performed well on multiple-choice from Bloom's taxonomy levels 4-6 and open-ended questions would perform well on GRM involving similar concepts. High performing students on GRM were predicted to have higher course grades. "The null hypothesis was question type would not have an effect on critical thinking assessment." In two quizzes, there was weak correlation between GRM and open-ended questions (R[superscript 2] =0.15), however there was strong correlation in the exam (R[superscript 2] =0.56). Correlations were consistently higher between GRM and multiple-choice from Bloom's taxonomy levels 4-6 (R[superscript 2] =0.23,0.31,0.21) versus levels 1-3 (R[superscript 2] =0.13,0.29,0.18). GRM is a viable alternative to multiple-choice in critical thinking assessment without added resources and grading efforts.
Descriptors: Alternative Assessment, Multiple Choice Tests, Test Items, Test Format, Item Response Theory, Critical Theory, Taxonomy, Large Group Instruction, Introductory Courses, Predictor Variables, Student Evaluation, College Freshmen, Test Wiseness, Foreign Countries
Sciedu Press. 1120 Finch Avenue West Suite 701-309, Toronto, ON., M3J 3H7, Canada. Tel: 416-479-0028; Fax: 416-642-8548; e-mail: email@example.com; Web site: http://www.sciedupress.com/journal/index.php/jct
Publication Type: Journal Articles; Reports - Research; Tests/Questionnaires
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Identifiers - Location: Canada