NotesFAQContact Us
Search Tips
ERIC Number: ED409320
Record Type: Non-Journal
Publication Date: 1997-Mar
Pages: 17
Abstractor: N/A
Reference Count: N/A
The Effect of Cluster Sampling Design in Survey Research on the Standard Error Statistic.
Wang, Lin; Fan, Xitao
Standard statistical methods are used to analyze data that is assumed to be collected using a simple random sampling scheme. These methods, however, tend to underestimate variance when the data is collected with a cluster design, which is often found in educational survey research. The purposes of this paper are to demonstrate how a cluster design affects the standard error statistic and the subsequent analyses, and to present practical techniques to analyze data from cluster designs correctly. A heuristic example is given to illustrate how to compute the variance estimate for a cluster design and the corresponding design effect. Simulation data is then used to examine variance estimation results from one- and two-stage cluster designs, respectively. Both a formula approach and a jackknife resampling approach are used in obtaining variance estimates. It is shown that, for 150 observations sampled from a population of 1,000, using a 2-stage cluster design, the actual variance can be underestimated by a factor of 3 if the standard statistical method is used. The underestimated variance or standard error statistic will lead to unwarranted statistical significance in hypothesis testing, or a narrow confidence interval in parameter estimation. Consequently, misleading conclusions can be made based on these inappropriate analysis findings. (Contains 1 tables and 11 references.) (Author/SLD)
Publication Type: Reports - Evaluative; Speeches/Meeting Papers
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A