ERIC Number: EJ1115407
Record Type: Journal
Publication Date: 2016-Sep
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-2252-8822
EISSN: N/A
Design and Implementation of Performance Metrics for Evaluation of Assessments Data
Ahmed, Irfan; Bhatti, Arif
International Journal of Evaluation and Research in Education, v5 n3 p235-245 Sep 2016
Evocative evaluation of assessment data is essential to quantify the achievements at course and program levels. The objective of this paper is to design performance metrics and respective formulas to quantitatively evaluate the achievement of set objectives and expected outcomes at the course levels for program accreditation. Even though assessment processes for accreditation are well documented but existence of an evaluation process is assumed. This work provides performance metrics such as attainment, student achievement, and x-th percentile for the evaluation of assessment data at course and program level. Then, a sample course data and uniformly distributed synthetic data are used to analyze the results from designed metrics. The primary findings of this work are twofold: (i) analysis with sample course assessment data reveals that qualitative mapping between marks obtained in assessments to the defined outcomes is essential for meaningful results, (ii) analysis with synthetic data shows that higher values of one metric does not imply higher values of the other metrics and they depend upon the obtained marks distribution. In particular, for uniformly distributed marks, "achievement < attainment for meanOfUniformDistr: < averageMarks < passingThreshold(a)." Authors hope that the articulated description of evaluation formulas will help convergence to high quality standard in evaluation process.
Descriptors: Measurement, Evaluation Methods, Program Implementation, Accreditation (Institutions), Program Evaluation, Educational Assessment, Outcomes of Education, Academic Achievement, Student Attitudes, Performance Based Assessment, Performance, Program Design
Institute of Advanced Engineering and Science. C5 Plumbon, Banguntapan, Yogyakarta, 55198, Indonesia. Tel: +62-274-4534501; Fax: +62-274-564604; e-mail: ijere@iaesjournal.com; Web site: http://iaesjournal.com/online/index.php/ijere
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A