NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1015680
Record Type: Journal
Publication Date: 2013-Sep
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1531-7714
EISSN: N/A
Assumptions of Multiple Regression: Correcting Two Misconceptions
Williams, Matt N.; Gomez Grajales, Carlos Alberto; Kurkiewicz, Dason
Practical Assessment, Research & Evaluation, v18 n11 Sep 2013
In 2002, an article entitled "Four assumptions of multiple regression that researchers should always test" by Osborne and Waters was published in "PARE." This article has gone on to be viewed more than 275,000 times (as of August 2013), and it is one of the first results displayed in a Google search for "regression assumptions". While Osborne and Waters' efforts in raising awareness of the need to check assumptions when using regression are laudable, we note that the original article contained at least two fairly important misconceptions about the assumptions of multiple regression: Firstly, that multiple regression requires the assumption of normally distributed variables; and secondly, that measurement errors necessarily cause underestimation of simple regression coefficients. In this article, we clarify that multiple regression models estimated using ordinary least squares require the assumption of normally distributed errors in order for trustworthy inferences, at least in small samples, but not the assumption of normally distributed response or predictor variables. Secondly, we point out that regression coefficients in simple regression models will be biased (toward zero) estimates of the relationships between variables of interest when measurement error is uncorrelated across those variables, but that when correlated measurement error is present, regression coefficients may be either upwardly or downwardly biased. We conclude with a brief corrected summary of the assumptions of multiple regression when using ordinary least squares. (Contains 2 figures, 2 tables, and 1 footnote.)
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail: pare@umass.edu; Tel: 413-577-2180; Web site: https://scholarworks.umass.edu/pare
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A