NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1385295
Record Type: Journal
Publication Date: 2022
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1539-3100
EISSN: EISSN-1539-3119
An Item Response Theory Approach to Enhance Peer Assessment Effectiveness in Massive Open Online Courses
Nakayama, Minoru; Sciarrone, Filippo; Temperini, Marco; Uto, Masaki
International Journal of Distance Education Technologies, v20 n1 2022
Massive open on-line courses (MOOCs) are effective and flexible resources to educate, train, and empower populations. Peer assessment (PA) provides a powerful pedagogical strategy to support educational activities and foster learners' success, also where a huge number of learners is involved. Item response theory (IRT) can model students' features, such as the skill to accomplish a task, and the capability to mark tasks. In this paper the authors investigate the applicability of IRT models to PA, in the learning environments of MOOCs. The main goal is to evaluate the relationships between some students' IRT parameters (ability, strictness) and some PA parameters (number of graders per task, and rating scale). The authors use a data-set simulating a large class (1,000 peers), built by a Gaussian distribution of the students' skill, to accomplish a task. The IRT analysis of the PA data allow to say that the best estimate for peers' ability is when 15 raters per task are used, with a [1,10] rating scale.
IGI Global. 701 East Chocolate Avenue, Hershey, PA 17033. Tel: 866-342-6657; Tel: 717-533-8845; Fax: 717-533-8661; Fax: 717-533-7115; e-mail: journals@igi-global.com; Web site: https://www.igi-global.com/journals/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A