We tested the incremental impact of a job-related set of variables for explaining a utility judgment training effectiveness variable, that is, course completion skill preparedness, beyond background and course-related variables. Our respondents were two different emergency medical service samples, 415 basics and 742 paramedics, from the 2008 US Longitudinal Emergency Medical Technician Attributes and Demographic Study. Extending earlier research into the training of US emergency medical services staff, we developed scales for measuring two course-related affective reaction variables, quality of course materials and quality of lead instructor. We found for both samples that the quality of course materials and quality of lead instructor variables each significantly explained course completion skill preparedness variance beyond controlled-for background variables. We also found that the set of job-related variables explained further, additional variance and that job satisfaction was positively related to course completion skill preparedness for both samples. The limitations of the study and future research ideas are discussed.