ERIC Number: ED457376
Record Type: Non-Journal
Publication Date: 2001
Reference Count: N/A
Improving the Validity of Competency-Based Assessment.
Thomson, P.; Saunders, J.; Foyster, J.
A study was conducted to review the concept of validity in the context of vocational education and training (VET) in Australia. The study included a review of literature, case studies, presentation of key findings, and recommendation of a tool to guide assessors. An eight-faceted approach to validity, based on Nitko, was developed, with each approach using different kinds of evidence (content, internal coherence, external coherence, reliability, practicality, generalizability, consequential) that may be appropriate within a competency-based approach to assessment. The study showed that the eight types of evidence were, with a single exception (consequential evidence), regarded as important by the study participants. The study finds that the approach to validity indicated by Nitko can be fruitful in improving competency-based assessments. Other findings include the following: (1) some practitioners were reluctant to allow any scrutiny of their assessment practices; (2) records storage and retrieval were sometimes not well-developed; (3) there was no uniform definition of "recognition of prior learning" or "recognition of current competency"; (4) the use of holistic assessment left questions of validity open; and (5) attitude seems to be a factor in employment and on-the-job success but was beyond the scope of the study. A revised definition of validity was proposed that sees validity as "the extent to which the interpretation and use of an assessment outcome can be supported by evidence." (Contains 30 references.) (KC)
Descriptors: Competence, Criterion Referenced Tests, Definitions, Developed Nations, Educational Research, Evaluation, Evaluation Methods, Evaluation Needs, Evaluation Problems, Evaluation Research, Foreign Countries, Performance Based Assessment, Postsecondary Education, Secondary Education, Technical Education, Test Interpretation, Test Validity, Vocational Education
National Centre for Vocational Education Research, 252 Kensington Road, Leabrook, South Australia 5068, Australia (cat no. 621; $33 Australian). Tel: 08 8333 8400; Fax: 08 8331 9211; e-mail: email@example.com; Web site: http://www.ncver.edu.au. For full text: http://www.ncver.edu.au/research/proj/nr9040.pdf.
Publication Type: Information Analyses; Reports - Research
Education Level: N/A
Authoring Institution: National Centre for Vocational Education Research, Leabrook (Australia).
Identifiers - Location: Australia