NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED409342
Record Type: Non-Journal
Publication Date: 1997-Mar
Pages: 20
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
Error Sources Influencing Performance Assessment Reliability or Generalizability: A Meta Analysis.
Jiang, Ying Hong; And Others
As performance-based assessments have gained wider use, there are increasing concerns about their dependability. This study is a synthesis of existing studies regarding the reliability or generalizability of performance assessments. The meta-analysis involves summarizing, examining, and evaluating research findings. Articles on the dependability of performance assessments, analyzed through traditional means or a generalizability framework published after 1980 were selected. The literature search yielded 22 studies meeting the criteria for inclusion. These 22 studies yielded 258 different reliability or generalizability coefficients. Task and occasion facets contributed the greatest proportion of variance to estimates of error in the measurement procedure. Both are inherent in the construction of many performance tasks. The judge facet did not contribute a large proportion of error variance. Critics of performance assessment should not worry that the use of professional judgment to score performance assessment will be a major source of measurement error. (Contains 3 tables and 25 references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A