NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ908344
Record Type: Journal
Publication Date: 2011
Pages: 6
Abstractor: As Provided
Reference Count: 0
ISSN: ISSN-0891-4222
Using Relative Improvement over Chance (RIOC) to Examine Agreement between Tests: Three Case Examples Using Studies of Developmental Coordination Disorder (DCD) in Children
Cairney, John; Streiner, David L.
Research in Developmental Disabilities: A Multidisciplinary Journal, v32 n1 p87-92 Jan-Feb 2011
Although statistics such as kappa and phi are commonly used to assess agreement between tests, in situations where the base rate of a disorder in a population is low or high, these statistics tend to underestimate actual agreement. This can occur even if the tests are good and the classification of subjects is adequate. Relative improvement over chance or RIOC is a statistic that can correct for this bias; however, it is not yet commonly used in the health sciences or disability fields. In this paper, we introduce RIOC and demonstrate its application using the results from 3 previously published studies, all of which assessed the agreement between tests commonly used to identify children with a neurodevelopmental disorder known as developmental coordination disorder (or DCD). The results illustrate the differences between kappa and RIOC under conditions where the distribution of scores in a 2 x 2 table is unbalanced. The introduction of this statistic in the area of developmental disabilities research is encouraged. (Contains 3 tables and 1 figure.)
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A