ERIC Number: EJ721384
Record Type: Journal
Publication Date: 2005-Sep
Pages: 26
Abstractor: Author
Reference Count: 63
ISBN: N/A
ISSN: ISSN-0267-1522
Trusting Teachers' Judgement: Research Evidence of the Reliability and Validity of Teachers' Assessment Used for Summative Purposes
Harlen, Wynne
Research Papers in Education, v20 n3 p245-270 Sep 2005
This paper summarizes the findings of a systematic review of research on the reliability and validity of teachers' assessment used for summative purposes. In addition to the main question, the review also addressed the question "What conditions affect the reliability and validity of teachers' summative assessment?" The initial search for studies meeting the explicit inclusion criteria of relevance found 431 potentially relevant studies. This number was gradually reduced, through the systematic review procedures, to 30 studies, which specifically addressed the review questions. These studies were subject to in-depth data extraction conducted independently by two researchers, followed by reconciliation of any differences of interpretation. This procedure was also used to judge the weight of evidence provided for the review by each study so that greater emphasis could be given to findings from the most relevant and methodologically sound research. The findings of the review by no means constitute a ringing endorsement of teachers' assessment; there was evidence of low reliability and bias in teachers' judgements made in certain circumstances. However, this has to be considered against the low validity and lower than generally assumed reliability of external tests. The findings also point to ways of overcoming the deficiencies of teachers' assessment and lead to implications for assessment policy, practice and research, which are proposed in the final section of the paper.
Descriptors: Program Effectiveness, Validity, Student Evaluation, Evaluation Methods, Summative Evaluation, Educational Research, Teacher Effectiveness
Customer Services for Taylor & Francis Group Journals, 325 Chestnut Street, Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420 (Toll Free); Fax: 215-625-8914.
Publication Type: Information Analyses; Journal Articles
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers: N/A

Peer reviewed
Direct link
