Many interactive learning environments (ILEs) offer on-demand help, intended to positively influence learning. Recent studies report evidence that although effective help-seeking behavior in ILEs is related to better learning outcomes, learners are not using help facilities effectively. This selective review (a) examines theoretical perspectives on the role of on-demand help in ILEs, (b) reviews literature on the relations between help seeking and learning in ILEs, and (c) identifies reasons for the lack of effective help use. We review the effect of system-related factors, of student-related factors, and of interactions between these factors. The interaction between metacognitive skills and cognitive factors is important for appropriate help seeking, as are a potentially large space of system-related factors as well as interactions among learner- and system-related factors. We suggest directions for future research.