NotesFAQContact Us
Collection
Advanced
Search Tips
50 Years of ERIC
50 Years of ERIC
The Education Resources Information Center (ERIC) is celebrating its 50th Birthday! First opened on May 15th, 1964 ERIC continues the long tradition of ongoing innovation and enhancement.

Learn more about the history of ERIC here. PDF icon

Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ753692
Record Type: Journal
Publication Date: 2005-Jun
Pages: 16
Abstractor: Author
Reference Count: 14
ISBN: N/A
ISSN: ISSN-1363-6820
Assessing the Evidence: Different Types of NVQ Evidence and Their Impact on Reliability and Fairness
Greatorex, Jackie
Journal of Vocational Education and Training, v57 n2 p149-164 Jun 2005
The research literature reveals that there are many factors that influence the consistency of assessors' or examiners' judgements. One issue that has not been considered is whether National Vocational Qualifications assessors' consistency of judgement is affected by different types of evidence. In this article, 15 Customer Service and 12 Assessor and Verifier assessors made assessment judgements about fictitious candidates' evidence. For the Customer Service and Assessor and Verifier units the assessors made judgements about different types of evidence (assessor observations, witness testimonies, personal statements, written underpinning knowledge questions and answers, and record of professional discussions). The assessors' judgements were statistically analysed. The internal consistency reliability was high, indicating that assessors tend to respond to each assessment criterion within a set in a similar way or that each set of criteria are measuring a common trait. The results are also used to discuss the consistency of assessors' judgements and whether they are affected by different types of evidence. When absolute differences were used to measure inter-rater reliability there was a statistically significant difference for the Assessor and Verifier Award--the assessors' judgements were in less agreement when using the witness testimony than when they assessed other types of evidence. Therefore, the effect of different types of evidence on the agreement between assessors' judgements about competence cannot be dismissed as an issue. Further research is required before we can say precisely which types of evidence affect assessor judgements and in which circumstances. (Contains 3 tables and 6 notes.)
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals/default.html
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers: National Vocational Qualifications (England); United Kingdom