ERIC Number: ED452825
Record Type: RIE
Publication Date: 1999
Reference Count: N/A
New Directions in the Evaluation of the Effectiveness of Educational Technology.
Heinecke, Walter F.; Blasi, Laura; Milman, Natalie; Washington, Lisa
The Secretary's conference on evaluating the effectiveness of educational technology highlighted new and emerging data on technology effectiveness in primary and secondary education reflected in the latest research and promising practices. The intent was to influence the way educators, teachers, and policy makers evaluate and assess the growing investment in technology and to provide schools with tools and strategies for effective evaluation. This paper aims to inform the discussion by examining recent changes in evaluation theory and practices, and by clarifying some definitions of evaluation, technology and student learning. The paper highlights instances of promising practices and concludes with a list of recommendations concerning the evaluation of the effectiveness of technology in teaching and learning. These recommendations include the following. A more formative approach to the evaluation of technology is needed because of the rate of change in technologies. In order to get at the complexities of these processes, multiple measures (quantitative and qualitative) should be used. Evaluation design should incorporate longitudinal studies of cohorts of students over several years. In addition, evaluation designs should rely less on participants' self-reported attitudes and more on observations of participants' actions within learning contexts. Future evaluations should not focus on simple outcomes measures such as posttests, but should also focus on complex metrics describing the learning process, such as cognitive modeling. Implementation evaluations should be conducted prior to outcomes evaluations. Focus should be on description of the program, treatment or technological innovation, and stronger descriptions of how the technological innovation is configured should be developed. The complexity of educational technology should be recognized. (AEF)
Descriptors: Computer Assisted Instruction, Computer Uses in Education, Educational Practices, Educational Technology, Elementary Secondary Education, Evaluation Criteria, Evaluation Methods, Evaluation Needs, Instructional Effectiveness
For full text: http://www.ed.gov/technology/1999/whitepapers.
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Note: In: The Secretary's Conference on Educational Technology, 1999: Evaluating the Effectiveness of Technology. [Proceedings] (Washington, D.C., July 12-13, 1999); see IR 020 654.