ERIC Number: ED227859
Record Type: RIE
Publication Date: 1981-Nov
Pages: 58
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Evaluation of Online Searches.
Blood, Richard W.
Based on an analysis of online search evaluation forms collected from all types of U.S. libraries, and a pilot test of a draft evaluation form in selected federal research libraries, this report presents the work of the American Library Association's (ALA's) Machine-Assisted Reference Section (MARS) Committee on Measurement and Evaluation. The committee was concerned with the evaluation of searches conducted on commercially available systems such as DIALOG, ORBIT, and BRS. The report emphasizes the process of evaluating online services and the key importance of identifying clearly stated, measurable goals as the initial step in the evaluation process. Four major performance criteria--recall, relevance or precision, user effort, and response time--are identified as major evaluation criteria. The search evaluation form recommended by the MARS committee is appended. The design and use of this form and each of its 10 questions are discussed, as well as its place in an online search service's management information system. Questions ordinarily included on evaluation forms, but excluded from this recommended form, are also reviewed. Finally, the report considers sampling the users of online services, the analysis and interpretation of evaluation forms, and the implementation of modifications to online reference services based on users' evaluations. (Author/ESR)
Publication Type: Reports - Research; Tests/Questionnaires
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: American Library Association, Chicago, IL. Machine Assisted Reference Section.
Grant or Contract Numbers: N/A