ERIC Number: ED469244
Record Type: Non-Journal
Publication Date: 1995-Apr
Reference Count: N/A
The Impact of Local Dependencies on Some LSAT Outcomes. Statistical Report. LSAC Research Report Series.
Reese, Lynda M.
This study explored the impact of various degrees of violations of the item response theory (IRT) local independence assumption on the Law School Admission Test (LSAT) calibration and score distribution estimates. Initially, results from the LSAT and two other tests were investigated to determine the approximate state of local item dependence (LID) found in actual test data. Yen's Q3 statistic (W. Yen, 1984) was used for this purpose. Based on these analyses, four levels of LID were defined and associated data sets generated. Estimates from the simulated data were compared to their corresponding LSAT generating values in order to analyze the effects of the LID on IRT calibration and score distribution estimates. Results indicate that LID causes low scores to be underestimated and high scores to be overestimated. Effects on item and ability parameter and test characteristic curve estimation were clearly demonstrated. Score distributions were also markedly changed by the introduction of LID. The effects observed were mainly problematic for high LID levels. Deficiencies in Yen's Q3 statistic were also observed. (Contains 10 figures, 16 tables, and 32 references.) (Author/SLD)
Publication Type: Numerical/Quantitative Data; Reports - Research
Education Level: N/A
Authoring Institution: Law School Admission Council, Newtown, PA.