ERIC Number: EJ1031039
Record Type: Journal
Publication Date: 2014
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1436-4522
EISSN: N/A
Automatic Generation and Ranking of Questions for Critical Review
Liu, Ming; Calvo, Rafael A.; Rus, Vasile
Educational Technology & Society, v17 n2 p333-346 2014
Critical review skill is one important aspect of academic writing. Generic trigger questions have been widely used to support this activity. When students have a concrete topic in mind, trigger questions are less effective if they are too general. This article presents a learning-to-rank based system which automatically generates specific trigger questions from citations for critical review support. The performance of the proposed question ranking models was evaluated and the quality of generated questions is reported. Experimental results showed an accuracy of 75.8% on the top 25% ranked questions. These top ranked questions are as useful for self-reflection as questions generated by human tutors and supervisors. A qualitative analysis was also conducted using an information seeking question taxonomy in order to further analyze the questions generated by humans. The analysis revealed that explanation and association questions are the most frequent question types and that the explanation questions are considered the most valuables by student writers.
Descriptors: Electronic Learning, Natural Language Processing, Questioning Techniques, Classification, Models, Writing (Composition), Citation Analysis, Statistical Analysis, Needs Assessment, Critical Reading, Higher Education, Qualitative Research
International Forum of Educational Technology & Society. Athabasca University, School of Computing & Information Systems, 1 University Drive, Athabasca, AB T9S 3A3, Canada. Tel: 780-675-6812; Fax: 780-675-6973; Web site: http://www.ifets.info
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A