ERIC Number: ED369961
Record Type: Non-Journal
Publication Date: 1993
Reference Count: N/A
Job Knowledge Test Design: A Cognitively-Oriented Approach. Institute Report No. 241.
DuBois, David; And Others
Selected cognitive science methods were used to modify existing test development procedures so that the modified procedures could in turn be used to improve the usefulness of job knowledge tests as a proxy for hands-on performance. A plan-goal graph representation was used to capture the knowledge content and goal structure of the task of using a map, protractor, and compass for purposes of land navigation. Diagnosticity ratings were obtained from task experts to identify those content categories and procedures that would best discriminate among levels of examinee performance and specify the relative proportion of test questions to select. A probability-based inference network was used to score examinee responses and model a more complex pattern of relationships between knowledge and performance. A 100-question knowledge test was developed and used to test the land navigation skills of 358 Marines. Five hands-on proficiency tests (designed to evaluate planning, location, distance, direction, and movement skills) and a work sample performance test were also administered to the Marines. The 0.58 correlation between the job knowledge and hands-on tests and 0.42 correlation between the job knowledge and performance tests were interpreted as evidence supporting the utility of cognitive methods for improving job knowledge tests. (Contains 81 references.) (MN)
Publication Type: Reports - Research
Education Level: N/A
Sponsor: Office of the Chief of Naval Research, Washington, DC.
Authoring Institution: Personnel Decisions Research Institutes, Inc., Minneapolis, MN.