ERIC Number: ED274703
Record Type: RIE
Publication Date: 1986-Apr
Reference Count: 0
Training Instructional Designers and Subject Matter Experts in Test Development and Item Writing: Lessons from a Military Training Program.
Noonan, John V.; Nelson, Clare Cary
Although effective and efficient assessment procedures are crucial to the success of organizational training programs, the tests used for both student and program evaluation are often developed by instructional designers (IDS) and subject matter experts (SMEs) with little formal training in test development. This paper summarizes the major difficulties in training IDs and SMEs in test development and reviews strategies that facilitate this training. Training problems fall into three categories: negative attitudes about testing; mechanics of test development; and the utilization or application of tests. Negative attitudes can be diffused through increasing awareness of the benefits of testing as well as by introducing basic testing concepts and terminology. For training in test mechanics, there are excellent references such as the Psychological Corporation pamphlets. Short, activity seminars in item writing are effective methods to learn by doing (Appendix A, "Pop Quiz"). Useful references for test utilization and applications include the "Handbook for Testing in Navy Schools" and short explicit job aides, such as the "Job Aid for Embedded and Block Test Questions" (Appendix B). Involving IDs and SMEs in the decision-making process by the testing specialist is the most effective way for them to learn about test application and utilization. (BS)
Publication Type: Speeches/Meeting Papers; Reports - Descriptive; Tests/Questionnaires
Education Level: N/A
Authoring Institution: N/A
Note: Paper presented at the Annual Meeting of the American Educational Research Association (67th, San Francisco, CA, April 16-20, 1986).