NotesFAQContact Us
Collection
Advanced
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1179609
Record Type: Journal
Publication Date: 2018
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1927-5250
EISSN: N/A
An Investigation of Reliability Coefficients Estimated for Decision Studies in Generalizability Theory
Kamis, Ömer; Dogan, C. Deha
Journal of Education and Learning, v7 n4 p103-113 2018
This research aimed to compare the G and Phi coefficients estimated in Decision studies in Generalizability theory and obtained in actual cases for the same conditions of similar facets by using crossed design. The research was conducted as pure research on 120 individuals (students), six items and 12 raters. An achievement test composed of six open ended questions and a holistic rubric developed by the researcher were used in data collection. Data analysis included obtaining the G and Phi coefficients by creating actual cases for two, four and six raters followed by D studies conducted for other actual cases with different measurement conditions to make estimates. Finally, G and Phi coefficients obtained and estimated for two, four and six raters were compared separately. Findings show that G and Phi coefficients estimated in D studies by increasing the number of raters were sometimes greater than those obtained in actual cases although they were sometimes smaller. However, it was concluded that a pattern may not always exist between the G and Phi coefficients obtained in actual cases for same number of raters and those estimated in D studies.
Canadian Center of Science and Education. 1120 Finch Avenue West Suite 701-309, Toronto, OH M3J 3H7, Canada. Tel: 416-642-2606; Fax: 416-642-2608; e-mail: jel@ccsenet.org; Web site: http://www.ccsenet.org/journal/index.php/jel
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Turkey (Ankara)
Grant or Contract Numbers: N/A