ERIC Number: ED023421
Record Type: RIE
Publication Date: 1968
Reference Count: N/A
An Inquiry into Testing of Information Retrieval Systems. Part I: Objectives, Methodology, Design, and Controls. Comparative Systems Laboratory Final Technical Report.
Saracevic, Tefko; And Others
The Comparative Systems Laboratory (CSL) proposed to deal with the problem of testing retrieval systems by examining a number of processes involved in such systems, with particular attention to the human factor. It is hoped that the results of the project will be useful in refining methodologies for experimentation with information retrieval (IR) systems and in providing clues for the more effective design and redesign of operating IR systems. The first part of the final report of the project covers: a general introduction and state-of-the-art of IR system testing; the objectives, structure, and theoretical bases of CSL; the CSL experimental design as a whole; the operational definition and implementation of each retrieval system component involved in the experiment; and a detailed discussion of controls, with special attention given to implementation of output controls. Relevance judgements are also discussed in detail, and a summary of sources with the experimental variables which influences the results is given. A list of CSL technical reports and additional publications is appended. (Author/JB)
Descriptors: Information Retrieval, Information Systems, Input Output Analysis, Operations Research, Research Criteria, Research Design, Research Methodology, Systems Analysis
Clearinghouse for Federal Scientific and Technical Information, Springfield, Va. 22151 (PB-179 290, MF $.65, HC $3.00).
Publication Type: N/A
Education Level: N/A
Sponsor: Public Health Service (DHEW), Rockville, MD.
Authoring Institution: Case Western Reserve Univ., Cleveland, OH. Center for Documentation and Communication Research.
Identifiers: Comparative Systems Laboratory