ERIC Number: EJ1111824
Record Type: Journal
Publication Date: 2013
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1548-1093
EISSN: N/A
Determining the Consistency of Student Grading in a Hybrid Business Course Using a LMS and Statistical Software
Strang, Kenneth David
International Journal of Web-Based Learning and Teaching Technologies, v8 n2 p58-76 2013
Extant literature asserted that peer assessments improved learning but only a few studies had addressed the student rating consistency issue and had not evaluated this within a Learning Management System (LMS). The researcher explored how to conduct peer assessments in Moodle LMS for a hybrid-mode business course (N = 90 students) which required 270 (25-page) reports. Rater agreement statistical theory was applied to test the consistency of student peer assessments. The resulting coefficient was 0.79 and statistically significant. A pair-wise t-test and a nonparametric Mann Whitley u-test confirmed there was no significant difference between the student ratings and the scores given by the professor on the same assignments. Nonparametric Spearman correlation was very high between each student rating coefficient as compared to the score given in Moodle, which indicated the LMS was reliable in providing a grade for the quality of student peer assessment. A protocol was developed using SPSS to calculate a peer assessment inter-rater agreement consistency indicator since this was not available in Moodle.
Descriptors: Grading, Blended Learning, Computer Software, Statistical Analysis, Integrated Learning Systems, Educational Technology, Technology Uses in Education, Peer Evaluation, Nonparametric Statistics, Scores, Correlation, College Students
IGI Global. 701 East Chocolate Avenue, Hershey, PA 17033. Tel: 866-342-6657; Tel: 717-533-8845; Fax: 717-533-8661; Fax: 717-533-7115; e-mail: journals@igi-global.com; Web site: http://www.igi-global.com/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: New York
Grant or Contract Numbers: N/A