ERIC Number: ED247894
Record Type: RIE
Publication Date: 1984-Mar
Reference Count: 0
Assessment of Techniques for Evaluating Computer Systems for Federal Agency Procurements. Final Report.
Developed to identify and qualitatively assess computer system evaluation techniques for use during acquisition of general purpose computer systems, this document presents several criteria for comparison and selection. An introduction discusses the automatic data processing (ADP) acquisition process and the need to plan for uncertainty through contractual flexibility. Current constraints in evaluating computer systems are identified. Decision factors which affect the choice of evaluation techniques are examined, including both agency-dependent factors and general factors such as conformance with federal procurement regulations, accuracy, cost, perceived fairness/acceptibility to vendors, and ease of understanding. The following evaluation techniques are then appraised with regard to those parameters: proposal data analysis, applying experience of the evaluator(s), instruction timing analysis, rating charts analysis, analytic modeling and simulation, benchmarking (timed benchmark tests and functional demonstrations), and prototyping. Additional information on the use of evaluation techniques is included as well as appendices containing a three-page reference list, a list of organizational information sources, and additional guidelines on benchmarking. (Author/LMM)
Descriptors: Benchmarking, Computer Simulation, Computer Software, Computers, Contracts, Costs, Data Analysis, Equipment Evaluation, Evaluation Criteria, Evaluation Methods, Federal Programs, Models, Purchasing
Superintendent of Documents, U.S. Government Printing Office, Washington, DC 20402.
Publication Type: Guides - General; Reports - Evaluative
Education Level: N/A
Authoring Institution: National Bureau of Standards (DOC), Washington, DC. Inst. for Computer Sciences and Technology.
Note: Based in part on the Contract Report (NB81SBCA0810) of the MITRE Corporation.