ERIC Number: EJ1167892
Record Type: Journal
Publication Date: 2018
Abstractor: As Provided
Multilevel Modeling and Ordinary Least Squares Regression: How Comparable Are They?
Huang, Francis L.
Journal of Experimental Education, v86 n2 p265-281 2018
Studies analyzing clustered data sets using both multilevel models (MLMs) and ordinary least squares (OLS) regression have generally concluded that resulting point estimates, but not the standard errors, are comparable with each other. However, the accuracy of the estimates of OLS models is important to consider, as several alternative techniques (e.g., bootstrapping) used when analyzing clustered data sets only make adjustments to standard errors but not to the regression coefficients. Using a Monte Carlo simulation, we analyzed 54,000 data sets using both MLM and OLS under varying conditions and we show that coefficients of not just OLS models, but MLMs as well, may be biased when relevant higher-level variables are omitted from a model, a situation that is likely to occur when using large-scale, secondary data sets. However, we demonstrate that by including aggregated level-one variables at the higher level, the resulting bias can be effectively removed.
Descriptors: Hierarchical Linear Modeling, Least Squares Statistics, Regression (Statistics), Comparative Analysis, Monte Carlo Methods, Data Analysis, Statistical Bias, Error of Measurement, Probability, Correlation
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A