ERIC Number: ED379724
Record Type: RIE
Publication Date: 1994-Nov
Immediate Computerized Feedback in the Evaluation of Undergraduate Public Speaking: Development of the Computerized Competent Speaker Evaluation System and Testing of Its Viability and Efficacy.
Witter, Stephen D.; And Others
A study determined the viability and effectiveness of the Computerized Competent Speaker Evaluation System. A total of 659 comments made by undergraduate students about the paper version of the Competent Speaker Speech Evaluation Form were subjected to two Q sorts. The 635 comments that emerged were incorporated into the evaluation system during its development. Subjects were taken from four recitation sections (each with 15 to 20 students) of an introductory public speaking course. Speeches made by the students in two control groups were evaluated with the traditional handwritten method using the printed version of the speech evaluation form. Speeches of students in the two experimental groups were evaluated with the computerized version of the form. Graduate teaching assistants evaluated the speeches. Results were invalid since raters scored speeches considerably differently. Results of a posttest questionnaire of students indicated that they perceived the system to be viable and efficacious. Analyses of a journal kept during the test period and of posttest interviews with the graduate teaching assistants using the system provided additional insights into the computerized evaluation system. Findings suggest that the system is viable, but the system's effectiveness is not yet established due to problems of low interrater reliability. (Contains 23 references and 5 tales of data. Evaluation forms, criteria for use of forms, sample screens from the computerized systems, a sample printout, and cost estimates for the computerized systems are attached. (RS)
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the Speech Communication Association (80th, New Orleans, LA, November 19-22, 1994).