ERIC Number: ED333017
Record Type: RIE
Publication Date: 1991-Apr-2
Reference Count: 0
Evaluating the Replicability of Multivariate Assessment and Evaluation Results: A Review of Various Applications of the Cross-Validation Logic.
Crowley, Susan L.; Thompson, Bruce
Selected methods for evaluating the stability of research results empirically are described, especially with regard to multivariate analysis. It is critically important to evaluate the influences of sampling error on obtained results; statistical significance testing does not inform judgment regarding the probable replicability or the sampling specificity of results. Data provided by K. J. Holzinger and F. Swineford (1939) are used to make the discussion more concrete. As a starting point, an example of a univariate invariance analysis is presented. Other techniques described and illustrated include: (1) multiple regression analysis; (2) factor analysis; and (3) canonical correlation analysis. Ten tables illustrate the data. An appendix contains the Statistical Package for the Social Sciences program used to implement the analyses. A 60-item list of references is included. (SLD)
Publication Type: Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Cross Validation; Invariance Principle; Research Replication; Sampling Error
Note: Paper presented at the Annual Meeting of the National Council on Measurement in Education (Chicago, IL, April 4-6, 1991).