ERIC Number: EJ1088564
Record Type: Journal
Publication Date: 2012
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1040-0419
EISSN: N/A
A Comparison of Assessment Methods and Raters in Product Creativity
Lu, Chia-Chen; Luh, Ding-Bang
Creativity Research Journal, v24 n4 p331-337 2012
Although previous studies have attempted to use different experiences of raters to rate product creativity by adopting the Consensus Assessment Method (CAT) approach, the validity of replacing CAT with another measurement tool has not been adequately tested. This study aimed to compare raters with different levels of experience (expert ves. nonexpert raters) using both CAT and the product creativity measurement instrument (PCMI) to assess the product creativity of 56 design works based on a design competition. The results showed that nonexpert raters who used either CAT or PCMI had higher interreliability than expert raters. Using PCMI was found to result in higher correlation than using CAT for the expert and nonexpert raters, although the correlation between the CAT and PCMI methods was statistically insignificantly different. After regression analysis, the results showed that all PCMI items had higher explanatory power for the creativity scores using CAT and, moreover, the nonexpert raters were found to have higher explanatory power than the expert raters. Based on these results, it is recommended that the use of both nonexpert raters and PCMI is an alternative way of enhancing the flexibility of product creativity assessment.
Descriptors: Creativity, Interrater Reliability, Construct Validity, Comparative Analysis, Correlation, Testing, Foreign Countries, Experiments, High School Students, Postsecondary Education, Statistical Analysis, Measurement, Measurement Techniques, Factor Analysis
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: High Schools; Secondary Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Taiwan
Grant or Contract Numbers: N/A