ERIC Number: ED414329
Record Type: RIE
Publication Date: 1997-Feb-21
Reference Count: N/A
Content Validation: A Comparison of Methodologies.
Melnick, Steven A.; Henk, William A.
This paper compares two methods of establishing content validity, forced-choice judgmental review and a latent category judgmental review. It also compares content validity evidence with the results of a scale reliability analysis and makes recommendations of the two content validity procedures. Two different groups of graduate students enrolled in a graduate program for reading specialists acted as expert reviewers for the content validation stage of the Reader Self Perception Scale (RSPS). Thirty students reviewed the items using the forced choice method of Gable and Wolf (1993) and the other 33 reviewed items using a latent category judgmental review process modified from that of Wiley (1967). In addition, the RSPS was administered to 2,733 fourth, fifth and sixth graders. While all test items were placed in the anticipated a priori categories by the forced choice reviewers, latent category reviewers identified finer distinctions among the items. It may be that the latent category method provides more accurate information with more distinctions among latent constructs. Reliability analysis of RSPS responses suggests that all items intercorrelate sufficiently and contribute to overall scale reliability. (Contains five tables and five references.) (SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the Eastern Educational Research Association (Hilton Head, SC, February 1997).