ERIC Number: EJ1165314
Record Type: Journal
Publication Date: 2018
Pages: 16
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0895-7347
EISSN: N/A
An Exploratory Analysis of Differential Item Functioning and Its Possible Sources in a Higher Education Admissions Context
Oliveri, Maria Elena; Lawless, Rene; Robin, Frederic; Bridgeman, Brent
Applied Measurement in Education, v31 n1 p1-16 2018
We analyzed a pool of items from an admissions test for differential item functioning (DIF) for groups based on age, socioeconomic status, citizenship, or English language status using Mantel-Haenszel and item response theory. DIF items were systematically examined to identify its possible sources by item type, content, and wording. DIF was primarily found in the citizenship group. As suggested by expert reviewers, possible sources of DIF in the direction of U.S. citizens was often in "Quantitative Reasoning" in items containing figures, charts, tables depicting real-world (as opposed to abstract) contexts. DIF items in the direction of non-U.S. citizens included "mathematical" items containing few words. DIF for the "Verbal Reasoning" items included geocultural references and proper names that may be differentially familiar for non-U.S. citizens. This study is responsive to foundational changes in the fairness section of the Standards for Educational and Psychological Testing, which now consider additional groups in sensitivity analyses, given the increasing demographic diversity in test-taker populations.
Descriptors: Test Bias, Comparative Analysis, Item Banks, Item Response Theory, Probability, Test Items, Verbal Ability, Thinking Skills, Statistical Analysis, Mathematics Instruction, Algebra, Geometry, Reading Comprehension, Citizenship, Reading, Literacy, Higher Education, College Admission, College Entrance Examinations, Graduate Study, Case Studies
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Graduate Record Examinations
Grant or Contract Numbers: N/A