Download full text
Download full text
ERIC Number: EJ1109865
Record Type: Journal
Publication Date: 2013-Dec
Abstractor: As Provided
Constructed-Response DIF Evaluations for Mixed-Format Tests. Research Report. ETS RR-13-33
Moses, Tim; Liu, Jinghua; Tan, Adele; Deng, Weiling; Dorans, Neil J.
ETS Research Report Series, Dec 2013
In this study, differential item functioning (DIF) methods utilizing 14 different matching variables were applied to assess DIF in the constructed-response (CR) items from 6 forms of 3 mixed-format tests. Results suggested that the methods might produce distinct patterns of DIF results for different tests and testing programs, in that the DIF methods' results might be similar for tests with multiple-choice (MC) and CR scores that are similar in their measurement characteristics but would exhibit larger variations for tests with MC and CR scores having more distinct measurement characteristics. Impact measures of the MC and CR scores appeared to be a useful basis for indicating the scores' measurement similarity, for predicting the variations of DIF results from using these scores as matching variables, and possibly for indicating the most appropriate DIF method and matching variable for a particular test. The results are described in terms of their implications for research and practice.
Descriptors: Test Construction, Multiple Choice Tests, Test Items, Item Analysis, Scores, Prediction, Testing Programs, Gender Differences, Mathematical Formulas, Equations (Mathematics), Mathematics Tests, College Entrance Examinations, Test Results, Licensing Examinations (Professions), Statistical Analysis, Educational Principles, Teaching Methods, Teacher Qualifications
Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: RDweb@ets.org; Web site: https://www.ets.org/research/policy_research_reports/ets
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Praxis Series; SAT (College Admission Test)