ERIC Number: EJ1150160
Record Type: Journal
Publication Date: 2002
Abstractor: As Provided
Improving the Evaluation of Leadership Programs: Control Response Shift
Rohs, Frederick R.
Journal of Leadership Education, v1 n2 p50-61 Win 2002
The Cooperative Extension Service has been a key partner in the design, implementation and evaluation of leadership development programs. To evaluate the effectiveness of their training and the effects of response shift bias on outcomes using a self-report measure, one hundred forty-seven County Extension Agents participated in this leadership study. Participants were randomly assigned to one of two treatment groups or to a control group. Two different evaluation designs (pre-posttest and then-post) were used. The then-post design asks participants to first report their behavior or understanding as a result of the training (post) and then to retrospectively report this behavior before the training. The then-post evaluation design provided more significant change data than did the traditional pre-posttest design indicating a response shift occurred. Such differences in evaluation findings suggest that the educational benefit of such trainings may be underestimated when using the traditional pre-post evaluation design.
Descriptors: Program Evaluation, Leadership Training, Program Effectiveness, Extension Agents, Extension Education, Experimental Groups, Control Groups, Comparative Analysis, Pretests Posttests, Counties, Scores, Statistical Analysis, Leadership Effectiveness
Association of Leadership Educators. e-mail: Jole@aged.tamu.edu; Web site: http://leadershipeducators.org/page-1014283
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Identifiers - Location: Georgia
Grant or Contract Numbers: N/A