The purpose of this research is to investigate the relationship between computer technology's role and students' perceptions about course effectiveness. Students from two universities (one Canadian, n = 1465; one American, n = 831) completed a 71-item questionnaire addressing different aspects of their learning experience in a given course. Factor…

Critically examines five issues surrounding the use of student evaluations of teaching for summative decisions: current practices, validity concerns, improving the reporting of results, improving the decision-making process, and incorporating validity estimates into the decision-making process. Concludes with a list of recommendations for…

Preceding articles in this issue, "Improving Judgments about Teaching Effectiveness Using Teacher Rating Forms" (Abrami) and "Can We Put Precision into Practices? Commentary and Thoughts Engendered by Abrami's 'Improving Judgments about Teacher Effectiveness Using Teacher Rating Forms,'" offered: (1) Abrami's proposals to…

A common criticism of student ratings of instruction is that they are affected by the personal style of the instructor rather than an instructor's ability to convey instructional material. It was found that instructor expressiveness had a substanial impact on student ratings but a small impact on student achievement. (Author/PN)

Contrary to previous research, grading standards did not affect student achievement. The effect of standards on ratings was significant but not consistent for types of ratings (instructor expressiveness, lecture content), instructors, or differences in standards. Under certain conditions, higher grades either adversely affected ratings or had no…

Student ratings of instruction measure general instructional skill, give a composite of delivering instruction, facilitate interactions, and evaluate student learning. A meta-analysis of the multisection validity studies indicates student ratings are moderately valid, but affected by administrative, instructor, and course characteristics. (MMU)

Six quantitative reviews of the research on student ratings of instructional effectiveness are examined. The disparate conclusions of the reviews are explained by comparing the syntheses at each of five steps in a meta-analysis: specifying inclusion criteria; locating studies; coding study features; calculating study outcomes; and data analysis.…

The relationship between student/teacher attitude similarity and teacher rating form (TRF) scores is examined. Students (N=345) completed a 24-item attitude scale, once for themselves and once for their instructors, and a 28-item TRF. Attitude similarity is of minimum importance when evaluations are used to make gross distinctions among…

Two divergent views are contrasted: the multidimensional and the unidimensional views of faculty evaluation. The views of H. W. Marsh, the most outspoken advocate of the multidimensional view of evaluation based on factor scores, is summarized and a response to his concerns is presented. (Author/MLW)

The present study addressed the validity of student ratings of instructional effectiveness by exploring the relations among student ratings, course performance, and the perceived attitude similarity of students and their instructors. Findings fail to support the claim that perceived attitude similarity is a substantial source of bias in student…

Controversies exist in the research literature on student evaluation of instruction in higher education. In three studies, one of these controversies is explored, namely the relationship among student personality characteristics, teacher ratings, and student achievement. Findings suggest four conclusions relevant to summative evaluations of…

Limitations of the confirmatory factor analysis conducted by H. W. Marsh to demonstrate the multidimensionality of a rating form to assess student evaluation of teaching effectiveness are discussed. A secondary analysis suggests that dimensionality is not stable across solutions and a global factor can be retrieved. (SLD)

Multidimensional rating forms used for college student evaluation of faculty elicit information that can be used to evaluate the dimensions of instruction either separately or globally. Portions of the information may be useful for formative evaluation, but global items are best for making personnel decisions. (MSE)

Primary research on student ratings of instruction is reviewed, and questions about the validity of such ratings as measures of teacher effectiveness are explored using nomological coding of 43 validity studies to examine causes of variability in coefficients of validity. Deficiencies of prior analyses and research needs are identified. (SLD)