ERIC Number: ED282097
Record Type: RIE
Publication Date: 1986-Aug-24
Reference Count: 0
Content-Related Validation Techniques Applied to Training Evaluation.
Michener, Susan E.; Kesselman, Gerald A.
A job analysis to determine the technical functions of the job of mechanic in a utility company resulted in a Technical Competence Specification (TCS). The TCS identified the significant knowledge and skills organized into content domains. A content-related validation procedure determined the relevance of the mechanic training program content and ascertained the validity of post-training tests. The five training courses in the program were content analyzed by reviewing lesson plans and other instructional materials to produce a preliminary inventory of training elements for each course. Subject-matter experts (SMEs) rated each training element in the Training Program Content Inventory according to its job relevance. A content validity ratio (CVR) for each training inventory element resulted. The average of these ratings was computed as an overall content validity index for the inventory, for each course individually, and for each course module or topic area. In a manner parallel to the determination of course content relevance, SMEs linked each post-training test item to a TCS number and then applied the Lawshe rating procedure. The analysis of the training coverage showed that the curriculum well represented the important aspects of the job. CVRs indicated that test item reconstruction was warranted. (YLB)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Convention of the American Psychological Association (94th, Washington, DC, August 22-26, 1986).