NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: ED550494
Record Type: Non-Journal
Publication Date: 2014-Dec
Pages: 61
Abstractor: As Provided
Reference Count: 21
Measuring School Leaders' Effectiveness: An Interim Report from a Multiyear Pilot of Pennsylvania's Framework for Leadership. REL 2015-058
Teh, Bing-ru; Chiang, Hanley; Lipscomb, Stephen; Gill, Brian
Regional Educational Laboratory Mid-Atlantic
This study examines the accuracy of performance ratings from the Framework for Leadership (FFL), Pennsylvania's tool for evaluating the leadership practices of principals and assistant principals. The study analyzed three key properties of the FFL: internal consistency, score variation, and concurrent validity. To measure the internal consistency of the FFL, Cronbach's alpha was calculated for the full FFL and for each of its four categories of leadership practices. Score variation was characterized by the percentages of school leaders earning scores in different portions of the rating scale. Concurrent validity was assessed through a regression model for the relationship between school leaders' estimated contributions to student achievement growth and their FFL scores. Based on a pilot in which 336 principals and 69 assistant principals were rated by their supervisors in 2012/13, this interim report finds that the full FFL had good internal consistency for both principals and assistant principals. However, most scores for specific leadership practices were in the top two of four possible performance levels, and FFL scores were not associated with school leaders' contributions to student achievement growth. These findings suggest that more evidence is needed on the validity of using FFL scores to identify effective and ineffective school leaders. The following are appended: (1) Prior research on measuring principal effectiveness; (2) Structure of the Framework for Leadership; (3) Data used in the study; (4) Technical details and supplementary findings on the internal consistency of the Framework for Leadership; (5) Technical details and supplementary findings on variation in Framework for Leadership scores; (6) Technical details of school and leader value-added models; and (7) Technical details and supplementary findings on the relationships between Framework for Leadership scores and school leaders' value-added.
Regional Educational Laboratory Mid-Atlantic. Available from: Institute of Education Sciences. 555 New Jersey Avenue NW, Washington, DC 20208. Tel: 800-872-5327; Web site:
Publication Type: Reports - Research; Numerical/Quantitative Data
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: Regional Educational Laboratory Mid-Atlantic (ED); National Center for Education Evaluation and Regional Assistance (ED); ICF International
Identifiers - Location: Pennsylvania
IES Funded: Yes
Grant or Contract Numbers: ED-IES-12-C-0006
IES Cited: ED563447; ED556130; ED563446