NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ822975
Record Type: Journal
Publication Date: 2009-Jan
Pages: 16
Abstractor: As Provided
Reference Count: 36
ISSN: ISSN-0895-7347
Comparability of Computer- and Paper-Administered Multiple-Choice Tests for K-12 Populations: A Synthesis
Kingston, Neal M.
Applied Measurement in Education, v22 n1 p22-37 Jan 2009
There have been many studies of the comparability of computer-administered and paper-administered tests. Not surprisingly (given the variety of measurement and statistical sampling issues that can affect any one study) the results of such studies have not always been consistent. Moreover, the quality of computer-based test administration systems has changed considerably over recent years, as has the computer-experience of students. This study synthesizes the results of 81 studies performed between 1997 and 2007. The estimated effect size across all studies was very small (-0.01 weighted, 0.00 unweighted). Meta-analytic methods were used to ascertain whether grade (elementary, middle, or high school) or subject (English Language Arts, Mathematics, Reading, Science, or Social Studies) had an impact on comparability. Grade appeared to have no affect on comparability. Subject did appear to affect comparability, with computer administration appearing to provide a small advantage for English Language Arts and Social Studies test (effect sizes of 0.11 and 0.15, respectively), and paper administration appearing to provide a small advantage for Mathematics tests (effect size of -0.06). (Contains 5 tables and 1 figure.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Information Analyses; Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A