NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ994510
Record Type: Journal
Publication Date: 2012
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0021-8855
EISSN: N/A
Influences of Response Rate and Distribution on the Calculation of Interobserver Reliability Scores
Rolider, Natalie U.; Iwata, Brian A.; Bullock, Christopher E.
Journal of Applied Behavior Analysis, v45 n4 p753-762 Win 2012
We examined the effects of several variations in response rate on the calculation of total, interval, exact-agreement, and proportional reliability indices. Trained observers recorded computer-generated data that appeared on a computer screen. In Study 1, target responses occurred at low, moderate, and high rates during separate sessions so that reliability results based on the four calculations could be compared across a range of values. Total reliability was uniformly high, interval reliability was spuriously high for high-rate responding, proportional reliability was somewhat lower for high-rate responding, and exact-agreement reliability was the lowest of the measures, especially for high-rate responding. In Study 2, we examined the separate effects of response rate per se, bursting, and end-of-interval responding. Response rate and bursting had little effect on reliability scores; however, the distribution of some responses at the end of intervals decreased interval reliability somewhat, proportional reliability noticeably, and exact-agreement reliability markedly. (Contains 2 figures and 1 table.)
Society for the Experimental Analysis of Behavior. Available from: Department of Applied Behavioral Science. Kansas University, 1000 Sunnyside Avenue, Lawrence, KS 66045-2133. Tel: 785-841-4425; Fax: 785-841-4425; e-mail: behavior@mail.ku.edu; Web site: http://seab.envmed.rochester.edu/jaba/index.html
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A