ERIC Number: ED338700
Record Type: Non-Journal
Publication Date: 1991-Jul
Reference Count: N/A
Steps in Designing an Indicator System. ERIC/TM Digest.
Shavelson, Richard J.; And Others
Some steps to identify an initial set of indicators and to develop alternative indicator systems are outlined for educational evaluation and illustrated through the example of a National Science Foundation (NSF) study of mathematics and science education. The first step is to conceptualize potential indicators to specify a comprehensive monitoring system containing inputs, processes, and outputs. The potentially important indicators identified through this model are refined through eight criteria for selecting indicators of the major components of schooling. It was assumed that indicators should: (1) reflect the central features of mathematics and science education; (2) provide information pertinent to current or potential problems; (3) measure factors that policy can influence; (4) measure observed behavior rather than perceptions; (5) be reliable and valid; (6) provide analytical links; (7) be feasible to implement; and (8) address a broad range of audiences. After the indicators are selected, alternative data collection strategies to build the system must be designed. The alternatives require evaluation for utility, feasibility, and cost. After selection of one alternative, the individual indicators are developed and refined. Reviewing research on the key components and indicators of mathematics and science education highlights the necessity of a research agenda to improve indicator systems. There are three references. (SLD)
Descriptors: Data Collection, Educational Assessment, Educational Indicators, Educational Policy, Elementary Secondary Education, Evaluation Criteria, Evaluation Methods, Formative Evaluation, Management Information Systems, Mathematics Education, Research Methodology, Research Needs, Science Education, Systems Development
Publication Type: ERIC Publications; Reports - Evaluative; ERIC Digests in Full Text
Education Level: N/A
Sponsor: Office of Educational Research and Improvement (ED), Washington, DC.
Authoring Institution: ERIC Clearinghouse on Tests, Measurement, and Evaluation, Washington, DC.