ERIC Number: ED365682
Record Type: RIE
Publication Date: 1993-Aug
Reference Count: N/A
The Validity of Evaluation/Survey Service Survey Instruments for Reflecting Institutional Change.
Mittelholtz, David J.; Noble, Julie P.
The two studies reported examined the validity of several Evaluation/Survey Service (ESS) surveys for accurately reflecting changes in students' perceptions resulting from changes made by an institution in its policies, programs, services, or environment. In study 1, personnel from nine postsecondary institutions identified items on various ESS surveys for which student responses were expected to change as a result of changes made by the institution since the last survey administration. Actual changes were compared to projected changes, and mean student responses were compared for different administrations of a survey. In study 2, changes in mean student responses were identified for two or more administrations, and personnel were asked to provide explanations for these changes. Overall, the two studies strongly support the validity of the following three ESS instruments for reflecting changes in students' perceptions over time: (1) the Student Opinion Survey (4-year); (2) the Survey of Academic Advising; and (3) the Withdrawing/Nonreturning Student Survey. Three other ESS surveys received less support, perhaps because of the smaller sample sizes associated with these surveys. Four tables present response data. Six appendixes present additional information about study methodology, including cover letters and survey forms, and responses. (Contains 12 references.) (Author/SLD)
Descriptors: Academic Advising, Comparative Testing, Educational Change, Higher Education, Institutional Characteristics, Predictive Measurement, Research Methodology, Sample Size, Student Attitudes, Surveys, Test Validity, Withdrawal (Education)
ACT Research Report Series, P.O. Box 168, Iowa City, IA 52243.
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: N/A
Authoring Institution: American Coll. Testing Program, Iowa City, IA.
Identifiers: ACT Adult Learner Needs Assessment; ACT Evaluation Survey Service; ACT Survey of Academic Advising; ACT Withdrawing Nonreturning Student Surv; Entering Student Survey; Student Opinion Survey
Note: Contains thin, light type.