NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ856453
Record Type: Journal
Publication Date: 2009
Pages: 14
Abstractor: As Provided
Reference Count: 34
ISSN: ISSN-1530-5058
Judgmental and Statistical DIF Analyses of the PISA-2003 Mathematics Literacy Items
Yildirim, Huseyin Husnu; Berberoglu, Giray
International Journal of Testing, v9 n2 p108-121 2009
Comparisons of human characteristics across different language groups and cultures become more important in today's educational assessment practices as evidenced by the increasing interest in international comparative studies. Within this context, the fairness of the results across different language and cultural groups draws the attention of researchers. In the present study, the utility of hypothesis generated about differential item functioning (DIF) will be studied using the Program for International Student Assessment (PISA) 2003 data set. Items that were flagged as DIF through Restricted Factor Analysis (RFA), Mantel-Haenzsel (MH), and Item Response Theory Likelihood Ratio Analysis (IRT-LR) were simultaneously considered for content-wise evaluation. A group of judges reported that (1) cognitive skills measured by the items, (2) translation errors, and (3) use of quantitative words are three important sources of error that might be causing DIF in the PISA 2003 study. Results indicated that systematic a-priory analyses of the item content may help anticipate items with DIF in a cross-cultural comparison. Close agreement was obtained between the judges' opinions about DIF and statistical DIF analysis results. (Contains 4 tables.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey; United States
Identifiers - Assessments and Surveys: Program for International Student Assessment