ERIC Number: EJ1082000
Record Type: Journal
Publication Date: 2015
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1741-5659
EISSN: N/A
Increasing Testing Efficiency through the Development of an IT-Based Adaptive Testing Tool for Competency Measurement
Kleinhans, Janne; Schumann, Matthias
Interactive Technology and Smart Education, v12 n4 p242-255 2015
Purpose: This paper investigates the potential of computerized adaptive testing for CMs to reduce test time. In the context of education and training, competency measurement (CM) is a central challenge in competency management. For complex CMs, a compromise must be addressed between the time available and the quality of the measurements. Increasing the efficiency of existing tests therefore poses a key challenge. Design/methodology/approach: Results from a market analysis show a lack of integrated adaptive testing tools for CMs. The implementation, integration and evaluation of an appropriate adaptive component are presented for the example of the learning management system ILIAS used for a CM of health workers. The textbook scenario of a linear testing implementation is compared with results from the adaptive testing tool implementation. A simulation component is created to investigate the robustness of the adaptive test regarding answers that are inconsistent with the test person's ability. Findings: A test time reduction of 40 per cent is achieved by the adaptive test. The test shows high stability for up to 20 per cent of the answers being inconsistent with the test person's ability. Originality/value: Results indicate the high potential of computerized adaptive testing for CMs. The developed tool could be used for the implementation of combined multimedia computerized adaptive tests. Time savings could be utilized to improve measurement quality. Large-scale empirical studies on the interaction between competency dimensions could be facilitated. No other tool could be identified possessing these capabilities.
Descriptors: Computer Assisted Testing, Educational Technology, Time, Measurement, Competence, Integrated Learning Systems, Technology Uses in Education, Computer Software, Test Construction, Vocational Schools, Allied Health Personnel, Evaluation Methods, Foreign Countries
Emerald Group Publishing Limited. Howard House, Wagon Lane, Bingley, West Yorkshire, BD16 1WA, UK. Tel: +44-1274-777700; Fax: +44-1274-785201; e-mail: emerald@emeraldinsight.com; Web site: http://www.emeraldinsight.com
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Grant or Contract Numbers: N/A