NotesFAQContact Us
Collection
Advanced
Search Tips
ERIC Number: ED459844
Record Type: Non-Journal
Publication Date: 2001-Jun
Pages: 8
Abstractor: N/A
Reference Count: N/A
ISBN: N/A
ISSN: N/A
An Algorithm for Automated Rating of Reviewers.
Riggs, Tracy; Wilensky, Robert
The current system for scholarly information dissemination may be amenable to significant improvement. In particular, going from the current system of journal publication to one of self-distributed documents offers significant cost and timeliness advantages. A major concern with such alternatives is how to provide the value currently afforded by the peer review system. This paper proposes a mechanism that could plausibly supply such value. In the peer review system, papers are judged meritorious if good reviewers give them good reviews. In its place, the report proposes a collaborative filtering algorithm that automatically rates reviewers, and incorporates the quality of the reviewer into the metric of merit for the paper. Such a system seems to provide all the benefits of the current peer review system, while at the same time being much more flexible. The researchers have implemented a number of parameterized variations of this algorithm, and tested them on data available from a quite different application. Initial experiments suggest that the algorithm is in fact ranking reviewers reasonably. (Contains 19 references.) (Author/AEF)
Association for Computing Machinery, 1515 Broadway, New York NY 10036. Tel: 800-342-6626 (Toll Free); Tel: 212-626-0500; e-mail: acmhelp@acm.org. For full text: http://www1.acm.org/pubs/contents/proceedings/dl/379437/.
Publication Type: Reports - Research; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation, Arlington, VA.
Authoring Institution: N/A