NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED017297
Record Type: RIE
Publication Date: 1966-Jan
Pages: 1
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
METHODOLOGY FOR TEST AND EVALUATION OF DOCUMENT RETRIEVAL SYSTEMS- A CRITICAL REVIEW AND RECOMMENDATIONS.
SNYDER, MONROE B.; AND OTHERS
THE PURPOSE OF THE PROJECT WAS TO REVIEW THE TEST AND EVALUATION LITERATURE ON DOCUMENT RETRIEVAL SYSTEMS, TO IDENTIFY THE METHODOLOGICAL PROBLEMS, AND TO DEVELOP A SET OF RECOMMENDATIONS FOR RESEARCHERS IN THE FIELD. TWO BASIC TOOLS WERE DEVELOPED TO AID IN THE DESCRIPTION AND EVALUATION OF THE STUDIES REVIEWED. THE FIRST TOOL WAS A DESCRIPTIVE MODEL OF DOCUMENT RETRIEVAL SYSTEMS WHICH INCLUDED A REPRESENTATION OF THE FUNCTIONAL STEPS FROM DOCUMENT ACQUISITION TO FILE AND FROM QUERY ACQUISITION TO FILE. THIS MODEL WAS USED TO ORGANIZE IN A STANDARD MANNER THE CONTENT OF THE STUDIES. BY IDENTIFYING IN EACH OF THE STUDIES THE SUBSYSTEM(S) AND/OR VARIABLES OF CONCERN AND PLOTTING THEM WITHIN THE MODEL, IT WAS POSSIBLE TO DEVELOP A DETAILED PICTURE OF THE CONTENT AREAS THAT HAVE BEEN EMPHASIZED AND THOSE THAT HAVE BEEN NEGLECTED. THE SECOND TOOL WAS THE "REVIEW FRAMEWORK" WHICH CONSISTED OF FIFTEEN RESEARCH DIMENSIONS. THE FRAMEWORK PROVIDED A COMMON BASE FOR DESCRIBING, ANALYZING AND EVALUATING THE STUDIES. FORTY-NINE STUDIES WERE ANALYZED FOR BOTH METHODOLOGICAL AND CONTENT CONSIDERATIONS. OF THESE 49 STUDIES, 37 WERE EXPERIMENTAL OR COMPARATIVE AND 12 WERE DESCRIPTIVE. EIGHT METHODOLOGICAL PROBLEMS WERE IDENTIFIED THROUGH THE EVALUATION PROCEDURE. RESEARCH RECOMMENDATIONS WERE DEVELOPED FOR EACH OF THESE PROBLEMS. A BIBLIOGRAPHY OF ABOUT 250 RELATED ITEMS IS INCLUDED. THIS DOCUMENT IS AVAILABLE AS PB-169-572 FROM THE CLEARINGHOUSE FOR FEDERAL SCIENTIFIC AND TECHNICAL INFORMATION, SPRINGFIELD, VIRGINIA 22151, $3.00 FOR HARD COPY, $0.65 FOR MICROFICHE, 132 PAGES. (AUTHOR/CM)
Publication Type: N/A
Education Level: N/A
Audience: N/A
Language: N/A
Sponsor: N/A
Authoring Institution: Human Sciences Research, Inc., McLean, VA.
Identifiers: N/A