ERIC Number: ED394971
Record Type: RIE
Publication Date: 1995-Jan
Reference Count: 0
An Independent Evaluation of the Kentucky Instructional Results Information System (KIRIS).
Western Michigan Univ., Kalamazoo. Evaluation Center.
This document contains the executive summary and the detailed report which provide an independent evaluation of Kentucky's new system for assessing student performance, the Kentucky Instructional Results Information System (KIRIS). The summary gauges progress to date, highlights some strengths to be built on and problems to be solved, and provides suggestions for improvement. The main report delineates the information needed to conduct a comprehensive evaluation of the reliability and validity of KIRIS. The evaluation was accomplished through study of technical documentation, reports, newspaper articles, and monographs; observation of KIRIS performance events exercises; interviews with key persons involved in development and implementation; observation of Kentucky educators meetings about KIRIS; and informal discussions with and attitudinal surveys from teachers, parents, principals, superintendents, and district assessment coordinators. In general, it was found that KIRIS was consistent with the requirements set forth by the Kentucky Education Reform Act (KERA) and that most stakeholders had some understanding of the rewards and sanctions component. Although Kentucky educators had been involved in the design and development of KIRIS, some teachers believed that questions on the assessment were written by persons with little or no knowledge of Kentucky. A need was found for much better organization and improved balance of the information generated. Teacher time spent on the assessment was deemed useful and reasonable, but the accountability index was found to be slow in providing teachers with timely feedback. Recommendations are offered about steps that could be taken to address the continuing needs for improvement. Appendices include a listing of the evaluation procedures and sources of evidence, a graphic outline of the system, and a letter responding to a citizen's concern about a particular question on the assessment. (NAV)
Descriptors: Educational Assessment, Elementary Secondary Education, Evaluation Utilization, Information Systems, Outcomes of Education, Performance Based Assessment, Program Evaluation, Rewards, Sanctions, State Departments of Education, State Standards, Student Evaluation, Test Reliability, Test Validity
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: Policymakers; Practitioners; Community
Sponsor: Kentucky Inst. for Education Research, Frankfort.
Authoring Institution: Western Michigan Univ., Kalamazoo. Evaluation Center.
Identifiers: Kentucky; Kentucky Education Reform Act 1990; Kentucky Instructional Results Information Syste
Note: For related documents, see SP 036 685-694.