ERIC Number: EJ1256338
Record Type: Journal
Publication Date: 2020-Jun
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-1554-5210
EISSN: N/A
Comparing Performance of Different Equating Methods in Presence and Absence of DIF Items in Anchor Test
Gübes, Nese; Uyar, Seyma
International Journal of Progressive Education, v16 n3 p111-122 Jun 2020
This study aims to compare the performance of different small sample equating methods in the presence and absence of differential item functioning (DIF) in common items. In this research, Tucker linear equating, Levine linear equating, unsmoothed and pre-smoothed (C=4) chained equipercentile equating, and simplified circle arc equating methods were considered. The data used in this study is 8 th-grade mathematics test item responses which obtained from Trends in International Mathematics and Science Study (TIMSS) 2015 Turkey sample. Item responses from Booklet-1 (N=199) and Booklet-14 (N=224) are chosen for this study. Data analyses were completed in four steps. In the first step, assumptions for DIF detection and test equating methods were checked. In the second step, DIF analyses were conducted with Mantel Haenszel and logistic regression methods. In the third step, Booklet 1 was chosen as base form and Booklet 14 chosen as a new form, then test equating was conducted under common item nonequivalent groups design. Test equating was done in two phases: the presence and absence of DIF items in the common items. Equating results were evaluated based on standard error of equating (se), bias and RMSE indexes. DIF analyses showed that there were two sizeable DIF items in anchor test. Equating results showed that performances of equating methods are similar in presence and absence of DIF items from anchor test and there is no notable change in se, bias and RMSE values. While the circle arc equating method outperformed other equating methods based on se, 4-moment pre-smoothed chained equipercentile equating method outperformed other methods based on bias and RMSE evaluation criteria. [This study was presented at the 6th International Congress on Measurement and Evaluation in Education and Psychology, KOSOVA.]
Descriptors: Test Bias, Equated Scores, Test Items, Methods, Achievement Tests, Foreign Countries, Mathematics Tests, Mathematics Achievement, International Assessment, Grade 8
International Association of Educators. Available from: PEN Academic Publishing. e-mail: secretary@inased.org; e-mail: info@penpublishing.net; Web site: http://www.inased.org/ijpe.htm; Web site: http://ijpe.penpublishing.net/
Publication Type: Journal Articles; Speeches/Meeting Papers; Reports - Research
Education Level: Elementary Education; Grade 8; Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Identifiers - Assessments and Surveys: Trends in International Mathematics and Science Study
Grant or Contract Numbers: N/A