NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ727509
Record Type: Journal
Publication Date: 2004
Pages: 4
Abstractor: Author
ISBN: N/A
ISSN: ISSN-1076-9986
EISSN: N/A
Can There Be Reliability without "Reliability?"
Mislevy, Robert J.
Journal of Educational and Behavioral Statistics, v29 n2 p241-244 2004
An "Educational Researcher" article by Pamela Moss (1994) asks the title question, "Can there be validity without reliability?" Yes, she answers, if by reliability one means "consistency among independent observations intended as interchangeable" (Moss, 1994, p. 7), quantified by internal consistency indices such as KR-20 coefficients and inter-rater correlations. Identifying this definition as the sine qua non of "a psychometric approach to drawing and warranting interpretations of human products or performances," Professor Moss describes a contrasting hermeneutic approach: "a holistic and integrative approach to interpretation of human phenomena that seeks to understand the whole in light of its parts, repeatedly testing interpretations against the available evidence until each of the parts can be accounted for in a coherent interpretation of the whole" (Moss, 1994, p. 7). One can thus draw valid inferences, the argument continues, from bodies of evidence that are not reliable. Are we witnessing the demise of a fundamental measurement principle, that without reliability, there is no validity?
American Educational Research Association, 1230 17th St. NW, Washington, DC 20036-3078. Tel: 202-223-9485; Fax: 202-775-1824; e-mail: subscriptions@aera.net; Web site: http://www.aera.net.
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A