PDF pending restoration
ERIC Number: ED349321
Record Type: RIE
Publication Date: 1991-Apr
Reference Count: 0
Alternative Procedures for Integrating Multidimensional Evaluations of Schools: An Experimental Comparison.
Jaeger, Richard M.; Usher, Claire H.
This paper reports on a study of the foundation and application of two procedures used to specify appropriate weights to be applied to components in determining the overall quality of a school. These procedures are multiattribute utility technology (MAUT) and policy capturing, and the paper presents the results of applying them, using key educational leaders in a southern state as judges. School components considered were: (1) selected core academic programs; (2) selected programs for specific subpopulations (special education and at-risk students); (3) a service delivery program; (4) selected administrative programs; and (5) several averaged student performances on standardized achievement tests. Using MAUT, judges identify attributes, determine their relative importance, estimate the value of each entity, derive an overall judgment for each, and investigate the consistency and sensitivity of judgments produced. Policy capture describes the unique information processing strategies of individual raters statistically. Judgment data were collected from 29 educational leaders through MAUT and policy capturing. Weights obtained from both procedures indicate that assigning equal weights to the attributes would misrepresent the values judges ascribed to these attributes as contributors to the overall quality of schools. Each procedure produced distributions of median weights that varied substantially from a uniform distribution, and analysis of the differences between them indicated that, if consistency of judgment is the criterion for selection of an attribute weighting method, policy capture is the method of choice. Two tables and four figures, which are replicated in an attached handout, present study data. There is a 61-item list of references. (SLD)
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Multi Attribute Utility Theory; Policy Capturing Method; Weighting (Statistical)
Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, April 3-7, 1991).