NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: EJ1290951
Record Type: Journal
Publication Date: 2020-Oct
Pages: 15
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0734-2829
EISSN: N/A
The Reliability of Framework for Teaching Scores in Kindergarten
Patrick, Helen; French, Brian F.; Mantzicopoulos, Panayota
Journal of Psychoeducational Assessment, v38 n7 p831-845 Oct 2020
We evaluated the score stability of the Framework for Teaching (FFT), a prominent observation instrument used for teacher evaluation. Three raters each scored 200 reading and mathematics lessons taught by 20 kindergarten teachers. Using Generalizability theory analyses, we decomposed the FFT's Classroom Environment, Instruction, and Total scores into potential sources of variation (teachers, lessons, raters, and their interactions). The scores' variances attributable to differences among teachers were 71% and 76% for Classroom Environment, 49% and 37% for Instruction, and 69% and 66% for the Total score, for reading and mathematics, respectively. Reliability estimates (G) ranged from 0.92 to 0.96 for Classroom Environment and Total scores; they were 0.87 and 0.79 for reading and mathematics Instruction. Decision studies indicated that two raters, each scoring three reading lessons or four mathematics lessons, are necessary to achieve sufficiently reliable Total scores. For Instruction scores, three raters each scoring seven readings lessons are needed; more than four raters each scoring eight lessons are needed for mathematics.
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research
Education Level: Early Childhood Education; Preschool Education; Elementary Education; Kindergarten; Primary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
Identifiers - Location: Indiana
IES Funded: Yes
Grant or Contract Numbers: R305A140664