ERIC Number: EJ1141165
Record Type: Journal
Publication Date: 2017-Jun
Abstractor: As Provided
The Nonuse, Misuse, and Proper Use of Pilot Studies in Experimental Evaluation Research
Westlund, Erik; Stuart, Elizabeth A.
American Journal of Evaluation, v38 n2 p246-261 Jun 2017
This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot studies can be misused, using statistical simulations to illustrate the error that can result from using effect sizes from pilot studies to decide whether to conduct a full trial or using effect sizes from pilot studies as the basis of power calculations in a full trial. Informed by the review of the literature and these simulation results, the authors conclude by proposing practical suggestions to researchers and practitioners on how to properly use pilot studies in experimental evaluation research.
Descriptors: Use Studies, Pilot Projects, Evaluation Research, Experiments, Research Design, Simulation, Error of Measurement, Effect Size, Statistical Analysis, Computation, Literature Reviews, Randomized Controlled Trials, Evaluation Methods, Case Studies
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: email@example.com; Web site: http://sagepub.com
Publication Type: Journal Articles; Reports - Research; Information Analyses
Education Level: N/A
Sponsor: Institute of Education Sciences (ED)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: N/A