NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED476924
Record Type: Non-Journal
Publication Date: 2003
Pages: 20
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
Comparing the Stability of IRT-Based and non IRT-Based DIF Methods in Different Cultural Contexts Using TIMSS Data.
Bertrand, Richard; Boiteau, Nancy
This study aimed at finding criteria like within-method stability rates or between-method agreement rates that could help to choose a powerful and low-cost differential item function (DIF) detection method. The study tried to verify the within-method stability of item response theory (IRT) based over non-IRT-based procedures in two different cultural contexts. Data from the Third International Mathematics and Science Study for 1995 and 1999 were used to see if the items identified as having translation DIF in 1995 between U.S. and Japanese groups were the same in 1999. Four procedures were used for that purpose: two IRT-based and two non-IRT-based. In each case, absolute and relative criteria were used to classify the strength of the DIF. The study also investigated between-method agreement rates. Results show that the non-IRT-based methods, especially Mantel Haenszel (a low cost method), possessed between-method agreement rates as high as those obtained by IRT-based methods. Also, the stability rates of non-IRT-based methods were found to be very close to the stability rates of IRT-based methods. (Contains 11 tables and 39 references.) (SLD)
Publication Type: Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Japan; United States
Identifiers - Assessments and Surveys: Trends in International Mathematics and Science Study