ERIC Number: EJ1103680
Record Type: Journal
Publication Date: 2016-Jul
Abstractor: As Provided
Using Computer-Assisted Assessment Heuristics for Usability Evaluations
Sim, Gavin; Read, Janet C.
British Journal of Educational Technology, v47 n4 p694-709 Jul 2016
Teaching practices within educational institutions have evolved through the increased adoption of technology to deliver the curriculum and the use of computers for assessment purposes. For educational technologists, there is a vast array of commercial computer applications available for the delivery of objective tests, and in some instances, organisations have opted to develop bespoke systems to meet their individual pedagogical requirements. However, there is very little research published on the usability of these systems and on the possible usability problems that could ultimately affect users' learning or users' marks in summative tests. This paper focuses on the effectiveness of the heuristic evaluation method for the evaluation of computer-assisted assessment (CAA) systems and proposes a set of CAA heuristics for evaluating assessment tools. The results of these tests show that, with little training, novice evaluators can effectively perform an evaluation and could, using this heuristic set, identify genuine usability problems within the assessment tool. Therefore, educational technologists or software developers could use the new CAA heuristic set to aid their procurement or inform their design decisions.
Descriptors: Computer Assisted Testing, Educational Technology, Heuristics, Usability, Teaching Methods, Computer Uses in Education, Computer Oriented Programs, Objective Tests, Program Evaluation, Program Effectiveness, Evaluation Methods
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: firstname.lastname@example.org; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A