ERIC Number: ED274878
Record Type: RIE
Publication Date: 1986-Oct-31
Reference Count: 0
Evaluating the Trustworthiness of Self-Assessments.
Long, James S.; Fransen, Steven C.
A retrospective self-assessment used with 22 county Extension agents from western Washington who had participated in a three-day inservice education program in agronomy was evaluated. Each participant was asked to draw an S on a Likert-type scale to indicate where each person started at the beginning of the workshop and an N where they perceived themselves to have ended; to list a workshop activity that helped the person move from S to N; and to suggest a learning activity that would help the person move from N to 100 percent achievement of that objective. Seven reasons were found for judging the assessments trustworthy: (1) the average change score was lower than the average assessment of before-workshop competence; (2) the range and pattern of pre-assessment fit the levels of formal education participants had in the content of the workshop; (3) the range of post-assessments reflected the varying job expectations among the participants; (4) change across five workshop objectives correlated with time allocated to each objective; (5) responses to "what helped" were substantive, relevant to the content of the workshop, appropriate to the objectives, and accurate; (6) suggestions for "what next" were also substantive, relevant, and appropriate; and (7) agents' data were congruent with the observations of other knowledgeable observers. The study suggested that quantitatively oriented, retrospective self-assessments may be trustworthy if they are constructed to elicit answers consistent with these seven characteristics. (KC)
Publication Type: Speeches/Meeting Papers; Reports - Evaluative
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the American Evaluation Association Conference (Kansas City, MO, October 31, 1986).