Many community colleges consider non-academic supports as a way to improve student retention and achievement. Past studies on the effects of coaching, mentoring, advising, and other non-academic supports yielded evidence for the effectiveness of these interventions to promote student outcomes. In addition, some suggested that the effects were stronger for more intense programs, as measured by meeting frequency. However, less was known about the effectiveness of these programs at community colleges or in cases where the intervention only lasts one semester. Our evaluation added to the body of rigorous research on the effects of academic coaching by applying a quasi-experimental design to analyze the outcomes of a short-term coaching intervention -- the InsideTrack Coaching program -- at two Montana community colleges. Using propensity score matching, the results showed positive impacts of short-term coaching, particularly for more intense coaching (two or more meetings in a semester), on student retention and achievement measures. These findings had implications for the types of short-term, high impact student support programming that community colleges might implement.