ERIC Number: EJ1078447
Record Type: Journal
Publication Date: 2015-Dec
Abstractor: As Provided
Reference Count: 55
Evaluation of Diagnostic Systems: The Selection of Students at Risk of Academic Difficulties
Smolkowski, Keith; Cummings, Kelli D.
Assessment for Effective Intervention, v41 n1 p41-54 Dec 2015
Diagnostic tools can help schools more consistently and fairly match instructional resources to the needs of their students. To ensure the best educational outcome for each child, diagnostic decision-making systems seek to balance time, clarity, and accuracy. However, recent research notes that many educational decisions tend to be made using professional judgment alone. Judgments grounded on data, statistical models, and even informal prediction models, however, outperform those based on intuition alone. The purpose of this manuscript is to describe the theoretical basis for signal detection and methods for statistically evaluating diagnostic decisions in education. We make recommendations to help test developers and consumers apply this methodology to other diagnostic systems in education and interpret the use of signal detection methods for educational screeners and diagnostic tests.
Descriptors: At Risk Students, Educational Diagnosis, Decision Making, Statistical Analysis, Screening Tests, Diagnostic Tests, Theories, Perception, Bias, Accuracy, Sample Size, Evaluation Methods
SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: email@example.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Authoring Institution: N/A