ERIC Number: ED274315
Record Type: RIE
Publication Date: 1984-Dec
Reference Count: 0
A Guide to Performance Evaluation of Database Systems.
Yao, S. Bing; Hevner, Alan R.
Benchmarking is one of several alternate methods of performance evaluation, which is a key aspect in the selection of database systems. The purpose of this report is to provide a performance evaluation methodology, or benchmarking framework, to assist in the design and implementation of a wide variety of benchmark experiments. The methodology, which identifies criteria to be utilized in the design, execution, and analysis of a database system benchmark, has been applied to three different database systems representative of current minicomputer, microcomputer, and database machine architectures. This generalized methodology can apply to most database system designs. In addition to presenting a wide variety of possible considerations in the design and implementation of the benchmark, this methodology can be applied to the evaluation of either a single system with several configurations, or to the comparison of several systems. A summary of the report identifies the three principal phases of a database system benchmark--benchmark design, execution, and analysis--and notes that no generalized methodology can provide a complete list of considerations for the design of an actual experiment. Seventy references are listed. (DJR)
Descriptors: Benchmarking, Database Management Systems, Databases, Evaluation Criteria, Evaluation Methods, Indexing, Performance, Reaction Time, Research Design
Superintendent of Documents, U.S. Government Printing Office, Washington, DC 20402.
Publication Type: Guides - Non-Classroom; Reports - Research
Education Level: N/A
Sponsor: National Bureau of Standards (DOC), Washington, DC. Inst. for Computer Sciences and Technology.
Authoring Institution: Software Systems Technology, College Park, MD.
Note: Part of the Series, Reports on Computer Science and Technology.