ERIC Number: ED028786
Record Type: RIE
Publication Date: 1966-Aug
Reference Count: N/A
The Measurability of Relevance. Comparative Systems Laboratory Technical Report No. 7.
Rees, Alan M.; Saracevic, Tefko
The history and significance of relevance as a concept in information retrieval is reviewed. The shift from the idea of relevance as an objective criterion for measures to the widespread acceptance of relevance as a manifestation of a highly subjective and inconsistent response is discussed. It is argued that relevance judgments can b e useful as a measuring instrument for testing the performance of information retrieval systems when a specific, ordered and finite (users), performing specified functions in specified subject areas for a specified purpose, within a specified environment and within a certain limited period in time. Experiments now in progress at Western Reserve University on the psychology of the relevance judgment process, related to the above hypothesis, are briefly described. Possible directions for future research on relevance are indicated. (Author)
Descriptors: Evaluation, Evaluation Methods, Information Retrieval, Information Systems, Measurement Instruments, Relevance (Information Retrieval), Research Projects
Clearinghouse for Federal Scientific and Technical Information, Springfield, Va. 22151 (PB 177 577, MF $0.65, HC $3.00)
Publication Type: N/A
Education Level: N/A
Sponsor: National Science Foundation, Washington, DC.; Public Health Service (DHEW), Arlington, VA.
Authoring Institution: Western Reserve Univ., Cleveland, OH. Center for Documentation and Communication Research.
Note: Paper presented at Annual Meeting of the American Documentation Institute (Santa Monica, Calif., Oct. 3-7, 1966)