ERIC Number: EJ1227295
Record Type: Journal
Publication Date: 2019
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0731-1745
EISSN: N/A
Construct Equivalence of PISA Reading Comprehension Measured with Paper-Based and Computer-Based Assessments
Educational Measurement: Issues and Practice, v38 n3 p97-111 Fall 2019
For many years, reading comprehension in the Programme for International Student Assessment (PISA) was measured via paper-based assessment (PBA). In the 2015 cycle, computer-based assessment (CBA) was introduced, raising the question of whether central equivalence criteria required for a valid interpretation of the results are fulfilled. As an extension of the PISA 2012 main study in Germany, a random subsample of two intact PISA reading clusters, either computerized or paper-based, was assessed using a random group design with an additional within-subject variation. The results are in line with the hypothesis of construct equivalence. That is, the latent cross-mode correlation of PISA reading comprehension was not significantly different from the expected correlation between the two clusters. Significant mode effects on item difficulties were observed for a small number of items only. Interindividual differences found in mode effects were negatively correlated with reading comprehension, but were not predicted by basic computer skills or gender. Further differences between modes were found with respect to the number of missing values.
Descriptors: Reading Comprehension, Computer Assisted Testing, Achievement Tests, Foreign Countries, International Assessment, Secondary School Students, Evaluation Criteria, Construct Validity, Test Format, Test Items
Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Germany
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A