ERIC Number: EJ850927
Record Type: Journal
Publication Date: 2009
Reference Count: 6
A Comment on "The "J" Index as a Measure of Nominal Scale Response Agreement"
Warrens, Matthijs J.
Applied Psychological Measurement, v33 n6 p486-487 2009
Various authors have proposed agreement indices for measuring nominal scale response agreement between two judges. Two situations may occur. Either the categories of the nominal scale are defined in advance and both raters use the same categories, or the categories are not defined in advance and the number of categories used by each rater is different. For the former case, the kappa statistic by Cohen (1960) is a popular measure. For the latter case, agreement measures have been proposed by Brennan and Light (1974), Hubert (1977), and Janson and Vegelius (1978, 1982). To choose the best or most appropriate coefficient, the various measures need to be better understood. The behavior of J and [gamma] in the general nominal case is a topic for further investigation. For the moment, only J exhibits none of the four undesirable properties described in this article and may for that reason be preferred over [gamma].
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: firstname.lastname@example.org; Web site: http://sagepub.com
Publication Type: Journal Articles; Opinion Papers
Education Level: N/A
Authoring Institution: N/A