ERIC Number: ED459844
Record Type: Non-Journal
Publication Date: 2001-Jun
Reference Count: N/A
An Algorithm for Automated Rating of Reviewers.
Riggs, Tracy; Wilensky, Robert
The current system for scholarly information dissemination may be amenable to significant improvement. In particular, going from the current system of journal publication to one of self-distributed documents offers significant cost and timeliness advantages. A major concern with such alternatives is how to provide the value currently afforded by the peer review system. This paper proposes a mechanism that could plausibly supply such value. In the peer review system, papers are judged meritorious if good reviewers give them good reviews. In its place, the report proposes a collaborative filtering algorithm that automatically rates reviewers, and incorporates the quality of the reviewer into the metric of merit for the paper. Such a system seems to provide all the benefits of the current peer review system, while at the same time being much more flexible. The researchers have implemented a number of parameterized variations of this algorithm, and tested them on data available from a quite different application. Initial experiments suggest that the algorithm is in fact ranking reviewers reasonably. (Contains 19 references.) (Author/AEF)
Descriptors: Data Processing, Electronic Journals, Electronic Publishing, Information Dissemination, Information Processing, Information Systems, Peer Evaluation, Scholarly Communication, Scholarly Journals
Association for Computing Machinery, 1515 Broadway, New York NY 10036. Tel: 800-342-6626 (Toll Free); Tel: 212-626-0500; e-mail: firstname.lastname@example.org. For full text: http://www1.acm.org/pubs/contents/proceedings/dl/379437/.
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Sponsor: National Science Foundation, Arlington, VA.
Authoring Institution: N/A