ERIC Number: ED453236
Record Type: Non-Journal
Publication Date: 2001-Apr-13
Reference Count: N/A
Identifying and Managing Local Item Dependence in Context-Dependent Item Sets.
Allen, Sally; Sudweeks, Richard R.
A study was conducted to identify local item dependence (LID) in the context-dependent item sets used in an examination prepared for use in an introductory university physics class and to assess the effects of LID on estimates of the reliability and standard error of measurement. Test scores were obtained for 487 students in the physics class. The test consisted of 24 context-dependent sets containing 3, 4, or 5 multiple choice items linked to a unique information display to yield 100 multiple choice items. The method used to identify LID was based on inter-item correlation matrices, with a matrix of the mean inter-item correlations constructed for each of five ability levels. Study results provide evidence that is possible to write context-dependent items that do not contain LID. Only 10 of the 24 item sets exhibited evidence of LID. If items do contain LID, it is possible to score the test in a way that will reduce its effects. Scoring the item sets as individual items or as testlets is not the best solution, but the benefits of using testlets can be gained by using mixed scoring gained from using the testlets accompanied by a procedure for estimating reliability. (Contains 22 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A