ERIC Number: ED409318
Record Type: RIE
Publication Date: 1997-Mar
Reference Count: N/A
An Evaluation of the Sample Designs in Educational Survey Research.
Wang, Lin; McNamara, James F.
This paper shares the findings of an inquiry that evaluated 50 survey articles published in a refereed journal, "Educational Administration Quarterly," by examining the 53 sample designs reported in the articles. The paper presents a typology of the sample designs identified, discusses the problems of sample selection and estimation procedures, and delineates possible ways to improve sample design practice in educational research. Major findings are that: (1) one- and two-stage sample selections were typically used in the survey sample designs; (2) the target or survey populations were not defined in about half of the sample designs; (3) where complex survey data was involved, variance estimates, obtained using the standard methods, were not adjusted to account for any possible design effects; and (4) potential nonresponse bias effects were not investigated in any designs with low response rates. Overall, the general quality of the selection procedures in the 53 sample designs was compromised by problems. Editors of this journal should require sufficient information about sample selection procedures. (Contains 3 tables and 36 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Authoring Institution: N/A
Identifiers: Educational Administration Quarterly; Variance (Statistical)
Note: Paper presented at the Annual Meeting of the American Educational Research Association (Chicago, IL, March 24-28, 1997).