NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1100293
Record Type: Journal
Publication Date: 2016-May
Pages: 13
Abstractor: As Provided
ISSN: EISSN-1531-7714
Regularization Methods for Fitting Linear Models with Small Sample Sizes: Fitting the Lasso Estimator Using R
Finch, W. Holmes; Finch, Maria E. Hernandez
Practical Assessment, Research & Evaluation, v21 n7 May 2016
Researchers and data analysts are sometimes faced with the problem of very small samples, where the number of variables approaches or exceeds the overall sample size; i.e. high dimensional data. In such cases, standard statistical models such as regression or analysis of variance cannot be used, either because the resulting parameter estimates exhibit very high variance and can therefore not be trusted, or because the statistical algorithm cannot converge on parameter estimates at all. There exists an alternative set of model estimation procedures, known collectively as regularization methods, which can be used in such circumstances, and which have been shown through simulation research to yield accurate parameter estimates. The purpose of this paper is to describe, for those unfamiliar with them, the most popular of these regularization methods, the lasso, and to demonstrate its use on an actual high dimensional dataset involving adults with autism, using the R software language. Results of analyses involving relating measures of executive functioning with a full scale intelligence test score are presented, and implications of using these models are discussed.
Center for Educational Assessment. 813 North Pleasant Street, Amherst, MA 01002. e-mail:; Tel: 413-577-2180; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: Wechsler Adult Intelligence Scale
Grant or Contract Numbers: N/A