NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1219256
Record Type: Journal
Publication Date: 2019
Pages: 13
Abstractor: As Provided
ISSN: ISSN-1049-4820
Comparing Machine Learning to Knowledge Engineering for Student Behavior Modeling: A Case Study in Gaming the System
Paquette, Luc; Baker, Ryan S.
Interactive Learning Environments, v27 n5-6 p585-597 2019
Learning analytics research has used both knowledge engineering and machine learning methods to model student behaviors within the context of digital learning environments. In this paper, we compare these two approaches, as well as a hybrid approach combining the two types of methods. We illustrate the strengths of each approach in the context of a case study in building models able to detect when students "game the system", a behavior in which learners abuse the environment's support functionalities in order to succeed by guessing or copying answers. We compare the predictive performance, interpretability and generalizability of models created using each approach, doing so across multiple intelligent tutoring systems. In our case study, we show that the machine-learned model required less resources to develop, but was less interpretable and general. In contrast, the knowledge engineering approach resulted in the most interpretable and general model. Combining both approaches in a hybrid model allowed us to create a model that performed best across the three dimensions, but requiring increased resources to develop.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A