ERIC Number: ED045730
Record Type: RIE
Publication Date: 1969-Sep
Reference Count: 0
A Computer Program for Calculation of Scott's Coefficient of Observer Reliability.
Gregory, Thomas B.
Scott's coefficient is an improved method for estimating observer reliability using any system which assigns events to mutually exclusive categories. The formula is the ratio of the actual difference between obtained and chance agreement to the maximum difference between obtained and chance agreement. A FORTRAN program for calculating this reliability coefficient is presented. The program can be used with from 2 to 20 observers and can include any number of observations as long as the product of the observations times the observers does not exceed 200. The observation system cannot exceed 30 categories. There are four outputs of the program including the average reliability coefficient of all possible pairs of observers, the average difference between all possible pairs of observers for each category, the percentage of each observer's total assignments found in each category, and each observer's average coefficient of reliability with all other observers. The data deck arrangement and program listing are included. (PR)
Publication Type: N/A
Education Level: N/A
Sponsor: Office of Education (DHEW), Washington, DC.
Authoring Institution: Texas Univ., Austin. Research and Development Center for Teacher Education.
Identifiers: FORTRAN Programing Language; Inter rater Reliability