ERIC Number: ED212656
Record Type: Non-Journal
Publication Date: 1978-Jun
Reference Count: N/A
Ongoing Studies in Domain-Referenced Content Validity: First Look at the "Judgment" Issue.
Baker, Eva; Polin, Linda
The validity studies planned for the Test Design activities deal primarily with the appropriateness of items generated for a domain. Previous exploratory work in the field related to overall test content appropriateness ratings has not been satisfactory. Studies which are solely based on correlational data suffer from confounding with instructional experience. For this reason, the research uses a validity procedure providing refined estimates of congruency using theoretically based judgmental methods and empirical information. The document develops an instrument to rate features of individual test items, stemming from concerns with descriptive validity and addressing the quality of the match between an item on a test and the overall test domain. The idea of rating the degree of this match was developed through "fuzzy set" theory in which it is possible to specify strength of membership, or degree of inclusion, for a set member along a range of decimal values from 0 to 1. (Author/CE)
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: N/A
Sponsor: National Inst. of Education (DHEW), Washington, DC.
Authoring Institution: California Univ., Los Angeles. Center for the Study of Evaluation.