ERIC Number: ED113372
Record Type: Non-Journal
Publication Date: 1973-Jul
Reference Count: N/A
Capturing Judgment Policies: An Application for Cadet Training at the United States Air Force Academy.
Taylor, Robert L.; And Others
Mathematical models of judgment policy are compared in evaluating 625 Cadet Performance Reports during a single rating cycle. Linear and nonlinear regressions are used to describe the cues most important in determining overall ratings. In addition, performance rating policy is compared with stated policy for each of forty cadet raters. In general, the findings support current literature in judgment policy-capturing. Cadet raters are internally consistent in applying their individual policies to cadet ratings. The relative importance of the ten cue variables varies significantly between raters while the aggregate data allow overall ratings to be described with only ten of the cues. There is no difference between the linear and nonlinear models in the amount of variance explained. The latter model does provide considerable insight into the composition of the overall ratings in terms of cue variable interactions. Finally, cadet raters' stated policies differ greatly from their actual policies. Recommendations are proposed to provide a more consistent interpretation and application of the Cadet Performance Report rating system. A logical extension of this study includes the implementation of a weighting scheme and a follow-on study to further validate the present findings. (NTIS)
Descriptors: Analysis of Variance, Comparative Analysis, Decision Making, Higher Education, Mathematical Models, Military Personnel, Multiple Regression Analysis, Performance Factors, Personnel Evaluation, Policy Formation, Rating Scales, Reliability, Student Evaluation
National Technical Information Service, Springfield, Va. 22161 (Order No. AD/A-005 064; MF $2.25, HC $3.25)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Air Force Academy, Colorado Springs, CO.