ERIC Number: ED030734
Record Type: Non-Journal
Publication Date: 1968-Jun
An Investigation of the Reliability and Validity of Selected Occupational Competency Examinations and Their Use in Evaluating Prospective Trade and Industrial Teachers. Final Report.
Koenigsberg, Lewis A.; Reilly, Robert R.
A 2-year investigation was initiated to determine the reliability and validity of the New York State competency tests used in selecting candidates for teacher preparation in the trade and industrial programs. The three most widely used tests--auto mechanics, cosmetology, and machine shop--were selected for investigation and further revision. Several statistical approaches were employed to test reliability of the written tests. Some findings were: (1) The mean difficulty of items was within the range considered acceptable, (2) The mean point biserial was lower for all tests than generally recommended, (3) The variability of difficulty levels was extremely high. On performance tests, comparison between judges rating applicants on performance showed a high relationship and intercorrelations among sub-scores were high. Qualified individuals were used to determine whether items reflect the important aspects of knowledge or skill the tests were designed to measure, and the relationship between examination scores and actual experience in the occupation was examined. Recommendations included: (1) pooling test data from all parts of the state, and (2) a plan for systematic review and updating. (JK)
Publication Type: N/A
Education Level: N/A
Authoring Institution: New York State Education Dept., Albany. Bureau of Occupational Education Research.; State Univ. of New York, Oswego. Coll. at Oswego. Div. of Vocational Technical Education.