ERIC Number: ED306308
Record Type: Non-Journal
Publication Date: 1989-Mar
Reference Count: N/A
Computer-Based and Paper-Based Measurement of Recognition Performance.
To determine the relative reliabilities and validities of paper-based and computer-based measurement procedures, 83 male student pilots and radar intercept officers were administered computer and paper-based tests of aircraft recognition. The subject matter consisted of line drawings of front, side, and top silhouettes of aircraft. Reliabilities for both modes of testing were estimated by deriving internal consistency indices, using an odd/even item split. Prior to testing, subjects learned to recognize the aircraft silhouettes using two media: (1) paper-based form structured as a study guide; and (2) computer-based form using FLASH IVAN in the training mode. A stepwise multiple discriminant analysis was performed to determine how well the two testing modes distinguished among two groups of subjects expected to differ in their recognition of aircraft silhouettes. Computer-based and paper-based measures were not significantly different in reliability or internal consistency. The paper-based measure of average degree of confidence in recognition judgments was more reliable than the computer-based measure. The average degree of confidence measured by the two modes was more equivalent than the measures of recognition test scores. The discriminative validities of the two measures were about the same for distinguishing groups above or below the mean average curriculum grade. Using the pooled within-groups correlations between the discriminant function and computer-based or paper-based measures, the former had superior discriminative validity than the latter. Statistics associated with the canonical correlation suggested that the predictive validity of computer-based measures approximates that of paper-based measures. Four tables present study data. A 54-item list of references is included. (SLD)
Publication Type: Reports - Research
Education Level: N/A
Authoring Institution: Navy Personnel Research and Development Center, San Diego, CA.