ERIC Number: EJ1106644
Record Type: Journal
Publication Date: 2016-Aug
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1059-0145
EISSN: N/A
Available Date: N/A
The Psychometric Properties of Classroom Response System Data: A Case Study
Kortemeyer, Gerd
Journal of Science Education and Technology, v25 n4 p561-574 Aug 2016
Classroom response systems (often referred to as "clickers") have slowly gained adoption over the recent decade; however, critics frequently doubt their pedagogical value starting with the validity of the gathered responses: There is concern that students simply "click" random answers. This case study looks at different measures of response reliability, starting from a global look at correlations between formative clicker responses and summative examination performance to how clicker questions are used in context. It was found that clicker performance is a moderate indicator of course performance as a whole, and that while the psychometric properties of clicker items are more erratic than those of examination data, they still have acceptable internal consistency and include items with high discrimination. It was also found that clicker responses and item properties do provide highly meaningful feedback within a lecture context, i.e., when their position and function within lecture sessions are taken into consideration. Within this framework, conceptual questions provide measurably more meaningful feedback than items that require calculations.
Descriptors: Audience Response Systems, Case Studies, Psychometrics, Reliability, Student Reaction, Correlation, Summative Evaluation, Performance, Test Items, Feedback (Response), Lecture Method, Introductory Courses, Physics, College Science, College Students, Item Response Theory
Springer. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: service-ny@springer.com; Web site: http://www.springerlink.com
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A