ERIC Number: EJ1100903
Record Type: Journal
Publication Date: 2015-Aug
Pages: 12
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1303-0485
EISSN: N/A
The Effects of Testlets on Reliability and Differential Item Functioning
Teker, Gulsen Tasdelen; Dogan, Nuri
Educational Sciences: Theory and Practice, v15 n4 p969-980 Aug 2015
Reliability and differential item functioning (DIF) analyses were conducted on testlets displaying local item dependence in this study. The data set employed in the research was obtained from the answers given by 1,500 students to the 20 items included in six testlets given in English Proficiency Exam by the School of Foreign Languages of a state University in Turkey. One of the purposes of this study was to determine the influences of the tests composed of testlets on reliability, so the reliability coefficients obtained for cases where the influences of testlets were considered and those for cases where the testlet influences were not considered were compared. In consequence of the G theory analyses conducted in this context, it was found that the G and Phi coefficients estimated by not considering the testlet effects were higher than those estimated by considering the testlet effects. It was concluded that the reliability was estimated to be relatively higher when the influences of the testlet were not considered. Two methods were used in this study so as to determine the effects of testlets on differential item functioning and the results were compared. In the DIF-determining method considering the testlet effect, both the number of items displaying DIF at the significant and estimated levels of DIF were found to be higher than in the method not considering the testlet effect.
Descriptors: Foreign Countries, Test Items, Test Bias, Item Response Theory, Test Reliability, English (Second Language), Language Tests, Language Proficiency, Universities, Influences, Statistical Analysis, Generalizability Theory
Educational Consultancy, Ltd (EDAM). Kisikli Mh. Alemdag Cd. Yan Yol Sk., SBK Is Merkezi No:5 Kat:1, Uskudar-Istanbul, 34692 Turkey. Tel: +90-216-481-30-23; Fax: +90-216-481-31-36; e-mail: editor@edam.com.tr; Web site: http://www.estp.com.tr/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey
Grant or Contract Numbers: N/A