NotesFAQContact Us
Search Tips
ERIC Number: EJ838613
Record Type: Journal
Publication Date: 2007-Nov
Pages: 21
Abstractor: As Provided
ISSN: ISSN-1540-2525
Examining Differences in Examinee Performance in Paper and Pencil and Computerized Testing
Puhan, Gautam; Boughton, Keith; Kim, Sooyeon
Journal of Technology, Learning, and Assessment, v6 n3 Nov 2007
The study evaluated the comparability of two versions of a certification test: a paper-and-pencil test (PPT) and computer-based test (CBT). An effect size measure known as Cohen's d and differential item functioning (DIF) analyses were used as measures of comparability at the test and item levels, respectively. Results indicated that the effect sizes were small (d less than 0.20) and not statistically significant (p greater than 0.05), suggesting no substantial difference between the two test versions. Moreover, DIF analysis revealed that reading and mathematics items were comparable for both versions. However, three writing items were flagged for DIF. Substantive reviews failed to identify format differences that could explain the performance differences, so the causes of DIF could not be identified. (Contains 2 tables and 3 figures.)
Technology and Assessment Study Collaborative. 332 Campion Hall, Boston College, Chestnut Hill, MA 02467. Tel: 617-552-4521; Fax: 617-552-8419; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A