Weighting adjustments are used in some studies to compensate for biased estimators produced by survey nonresponse. Using data from the 2004 National Survey of Student Engagement (NSSE) and the NSSE poststratification weighting algorithm, this study found that weighting adjustments were needed for some, but not all institutions. Unfortunately, no simple criterion for determining when weighting adjustments were needed could be identified. In addition, weighting adjustments reduced the precision of estimators for a majority of the institutions. Based on these findings, institutions and researchers concerned about compensating for nonresponse would be well advised to carefully evaluate the need for, and consequences of, weighting before employing weighting adjustments.