Download full text
Download full text
ERIC Number: EJ1105381
Record Type: Journal
Publication Date: 2007
Abstractor: As Provided
Engaging Academics with a Simplified Analysis of Their Multiple-Choice Question (MCQ) Assessment Results
Crisp, Geoffrey T.; Palmer, Edward J.
Journal of University Teaching and Learning Practice, v4 n2 Article 4 p88-106 2007
The appropriate analysis of students' responses to an assessment is an essential step in improving the quality of the assessment itself as well as staff teaching and student learning. Many academics are unfamiliar with the formal processes used to analyze assessment results; the standard statistical methods associated with analyzing the validity and reliability of an assessment are perceived as being too difficult for academics with a limited understanding of statistics. This inability of academics to apply conventional statistical tools with authority often makes it difficult for them to make informed judgements about improving the quality of the questions used in assessments. We analyzed students' answers to a number of selected response assessments and examined different formats for presenting the resulting data to academics from a range of disciplines. We propose the need for a set of simple but effective visual formats that will allow academics to identify questions that should be reviewed before being used again and present the results of a staff survey which evaluated the response of academics to these presentation formats. The survey examined ways in which academics might use the data to assist their teaching and students' learning. We propose that by engaging academics with a formal reflection of students' responses, academic developers are in a position to influence academics' use of specific items for diagnostic and formative assessments.
Descriptors: Multiple Choice Tests, Student Evaluation, Test Results, Test Construction, Test Items, Formative Evaluation, College Faculty, Psychometrics, Statistical Analysis, Online Surveys, Teacher Surveys, Norm Referenced Tests, Visual Aids, Scores, Graduate Study, Statistical Data, Item Response Theory
University of Wollongong. Available from: Centre for Educational Development and Interactive Resources. Northfields Avenue, Wollongong, NSW 2522, Australia. Tel: +61-2-4221-3140; Fax: +61-2-4225-8312; e-mail: firstname.lastname@example.org; Web site: http://ro.uow.edu.au/jutlp
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Grant or Contract Numbers: N/A