NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1361078
Record Type: Journal
Publication Date: 2022
Pages: 29
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0969-594X
EISSN: EISSN-1465-329X
The Blind Side: Exploring Item Variance in PISA 2018 Cognitive Domains
Marcq, Kseniia; Braeken, Johan
Assessment in Education: Principles, Policy & Practice, v29 n3 p332-360 2022
Communication of International Large-Scale Assessment (ILSA) results is dominated by reporting average country achievement scores that conceal individual differences between pupils, schools, and items. Educational research primarily focuses on examining differences between pupils and schools, while differences between items are overlooked. Using a variance components model on the Programme for International Student Assessment (PISA) 2018 cognitive domains of reading, mathematics, and science literacy, we estimated how much of the response variation can be attributed to differences between pupils, schools, and items. The results show that uniformly across domains and countries, it mattered more for the correctness of an item response which items were responded to by a pupil (27-35%) than which pupil responded to these items (10-12%) or which school the pupil attended (5-7%). Given the findings, we argue that differences between items in ILSAs constitute a source of substantial untapped potential for secondary research.
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Program for International Student Assessment
Grant or Contract Numbers: N/A