ERIC Number: EJ918757
Record Type: Journal
Publication Date: 2011-Aug
Pages: 11
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0360-1315
EISSN: N/A
Reliability and Validity of Web-Based Portfolio Peer Assessment: A Case Study for a Senior High School's Students Taking Computer Course
Chang, Chi-Cheng; Tseng, Kuo-Hung; Chou, Pao-Nan; Chen, Yi-Hui
Computers & Education, v57 n1 p1306-1316 Aug 2011
This study examined the reliability and validity of Web-based portfolio peer assessment. Participants were 72 second-grade students from a senior high school taking a computer course. The results indicated that: 1) there was a lack of consistency across various student raters on a portfolio, or inter-rater reliability; 2) two-thirds of the raters demonstrated inconsistency assessing different portfolios, i.e. inner-rater reliability; 3) peer-assessment scores were not consistent with teacher-assessment scores (criterion-related validity); 4) significant differences were found between peer-assessment scores and end-of-course examination scores, implying that Web-based portfolio peer assessment failed to reflect learning achievements (criterion-related validity). In short, Web-based portfolio peer assessment was not a reliable and valid method.
Descriptors: Portfolios (Background Materials), Portfolio Assessment, Validity, Interrater Reliability, Program Effectiveness, Internet, Student Evaluation, High School Students, Peer Evaluation, Comparative Analysis, Evaluation Methods, Computer Science Education, Case Studies
Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education; High Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A