ERIC Number: EJ1172528
Record Type: Journal
Publication Date: 2018
Abstractor: As Provided
Assessment of Interrater and Intermethod Agreement in the Kinesiology Literature
Looney, Marilyn A.
Measurement in Physical Education and Exercise Science, v22 n2 p116-128 2018
The purpose of this article was two-fold (1) provide an overview of the commonly reported and under-reported absolute agreement indices in the kinesiology literature for continuous data; and (2) present examples of these indices for hypothetical data along with recommendations for future use. It is recommended that three types of information be reported as evidence for agreement because no one type is superior to another. Report one graphical display (bivariate plot of raw scores with identity line or Bland-Altman plot), one scaled index (intraclass correlation coefficient with agreement definition or Lin's Concordance Correlation Coefficient), and at least one unscaled index (root mean squared deviation, total deviation index, coverage probability, or limits of agreement) when there are two methods/raters with no replication. The amount of information recommended exceeds what has commonly been reported in absolute agreement studies published in the kinesiology literature.
Descriptors: Interrater Reliability, Evaluation Methods, Kinetics, Indexes, Correlation, Scores, Statistical Analysis, Graphs, Scaling
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A