NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1130892
Record Type: Journal
Publication Date: 2017-Feb
Pages: 20
Abstractor: As Provided
ISSN: ISSN-1303-0485
An Alternative Method Used in Evaluating Agreement among Repeat Measurements by Two Raters in Education
Erdogan, Semra; Orekici Temel, Gülhan; Selvi, Hüseyin; Ersöz Kaya, Irem
Educational Sciences: Theory and Practice, v17 n1 p217-236 Feb 2017
Taking more than one measurement of the same variable also hosts the possibility of contamination from error sources, both singly and in combination as a result of interactions. Therefore, although the internal consistency of scores received from measurement tools is examined by itself, it is necessary to ensure interrater or intra-rater agreement in order to provide reliability. The biggest problem while conducting agreement analyses for obtained measurement results is deciding which statistical method to use. Inconsistency between measurements obtained by different methods over the same individual has been suggested as being similar to inconsistency between repeated measurements obtained by the same methods over the same individual. For this purpose, a new approach is proposed for estimating and defining an agreement coefficient between raters or methods. Based on this goal, an answer to the following question is sought: When the dependent/predicted variable has two categories (such as successful-unsuccessful, sick-healthy, positive-negative, exists-does not exist, etc.) and there are two raters who each undertake repeat measures, how does the method work in terms of disagreement functions and individual-agreement coefficient, as well as for different numbers of repeat measures and different sample sizes?
Educational Consultancy, Ltd (EDAM). Kisikli Mh. Alemdag Cd. Yan Yol Sk., SBK Is Merkezi No:5 Kat:1, Uskudar-Istanbul, 34692 Turkey. Tel: +90-216-481-30-23; Fax: +90-216-481-31-36; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A