Preparing competent staff is a critical issue within the camp community. This quasi-experimental study examined the effectiveness of an online course for improving staff competency in camp healthcare practices among college-aged camp staff and a comparison group (N = 55). We hypothesized that working in camp would increase competency test scores due to opportunities for staff to experientially apply knowledge learned online. Hierarchical linear modeling was used to analyse the cross-level effects of a between-individuals factor (assignment to experimental or comparison group) and within-individual effects of time (pre-test, post-test #1, and post-test #2) on online course test scores. At post-test #2, the difference in average test scores between groups was ~30 points, with the treatment group scoring lower on average than the comparison group. Factors that may have influenced these findings are explored, including fatigue and the limited durability of online learning. Recommendations for research and practice are discussed.