NotesFAQContact Us
Search Tips
ERIC Number: ED566756
Record Type: Non-Journal
Publication Date: 2015
Pages: 214
Abstractor: As Provided
Reference Count: N/A
ISBN: 978-1-3394-7931-6
Estimation and Psychometric Analysis of Component Profile Scores via Multivariate Generalizability Theory
Grochowalski, Joseph H.
ProQuest LLC, Ph.D. Dissertation, Fordham University
Component Universe Score Profile analysis (CUSP) is introduced in this paper as a psychometric alternative to multivariate profile analysis. The theoretical foundations of CUSP analysis are reviewed, which include multivariate generalizability theory and constrained principal components analysis. Because CUSP is a combination of generalizability theory and principal components analysis, CUSP was analyzed for accuracy and precision for small sample sizes via a simulation analysis. The stability and accuracy of CUSP analysis was also assessed using a large sample of examinee data (n = 5,000) from the College Board Advanced Placement (AP) Statistics subject test. The simulation showed that CUSP reliability estimates and coordinate estimates are generally unbiased when sample sizes were larger than n = 100. Subtest covariance structure caused significant bias in reliability and coordinate estimates when the covariance matrix was compound symmetric. Coordinate standard error estimates were significantly biased when sample sizes were very small (n<100). The AP data analysis, like the simulation, showed that profile estimates were consistent and stable for larger samples, but profile scores were inconsistent for the small sample condition (n = 50). CUSP external analysis illustrated the use of an external variable (gender) to define and predict AP Statistics profiles. The estimated external gender profile was not useful for classifying examinees by gender, achieving accuracy approximately equal to chance assignment. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page:]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site:
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Advanced Placement Examinations (CEEB)