ERIC Number: EJ1130886
Record Type: Journal
Publication Date: 2016
Abstractor: As Provided
A Maximum Likelihood Based Offline Estimation of Student Capabilities and Question Difficulties with Guessing
Moothedath, Shana; Chaporkar, Prasanna; Belur, Madhu N.
Perspectives in Education, v34 n4 p99-115 2016
In recent years, the computerised adaptive test (CAT) has gained popularity over conventional exams in evaluating student capabilities with desired accuracy. However, the key limitation of CAT is that it requires a large pool of pre-calibrated questions. In the absence of such a pre-calibrated question bank, offline exams with uncalibrated questions have to be conducted. Many important large exams are offline, for example the Graduated Aptitude Test in Engineering (GATE) and Japanese University Entrance Examination (JUEE). In offline exams, marks are used as the indicator of the students' capabilities. In this work, our key contribution is to question whether marks obtained are indeed a good measure of students' capabilities. To this end, we propose an evaluation methodology that mimics the evaluation process of CAT. In our approach, based on the marks scored by students in various questions, we iteratively estimate question parameters such as difficulty, discrimination and the guessing factor as well as student parameters such as capability using the 3-parameter logistic ogive model. Our algorithm uses alternating maximisation to maximise the log likelihood estimate for the questions and students' parameters given the marks. We compare our approach with marks-based evaluation using simulations. The simulation results show that our approach out performs marks-based evaluation.
Descriptors: Guessing (Tests), Computer Assisted Testing, Adaptive Testing, Maximum Likelihood Statistics, Computation, Difficulty Level, Test Items, Evaluation Methods, Comparative Analysis, Simulation
University of the Free State Faculty of Education. P.O. Box 339, Bioemfontein 9300, South Africa. Tel: +27-51-401-2368; e-mail: PiE@ufs.ac.za; Web site: http://apps.ufs.ac.za/kovsiejournals/default.aspx?journal=22
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A